METHOD AND APPARATUS FOR DETECTING AND INTERPRETING PATH 
OF DESIGNATED POSITION 

BACKGROUND OF TH E INVENTION 

Field of the Tnvpntinn 

The present invention relates to a position information 
processing apparatus, and more particularly, to a position 
information processing apparatus that detects position 
coordinates and paths of the position coordinates input by a 
finger, a pen, or a pointer, and interprets an instruction, 
input by a user and represented by the path, to perform an 
operation. 

Description of the Elated Art 

Conventional touch panels allow position coordinates of 
a plurality of contact points to be detected in operation. 

Such a conventional device detects a single input at a 
point as unknown input data during another point being 
designated fixedly, and is unable to detect paths of two or 
more designated positions that are concurrently moving. 

The device thus cannot interpret a designation 
represented by a combination of paths of a plurality of 
designated positions that are concurrently moving. 



It is an object of the present invention to provide an 
information processing apparatus and an information 
processing method for detecting paths of at least two 
designated positions that are concurrently moving. 

It is another object of the present invention to 
provide an apparatus and method for interpreting a user's 
designation represented by a combination of paths of at 
least two designated positions, and for performing a 
designated operation. 

According to one aspect, the present invention which 
achieves these objects relates to an information processing 
apparatus and includes a designated position detector for 
concurrently detecting a plurality of designated positions, 
a designated position storage unit for storing the plurality 
of designated positions detected by the designated position 
detector, a travel path recognizer for recognizing the 
travel paths of the plurality of designated positions based 
on the plurality of preceding designated positions stored in 
the designated position storage unit and the plurality of 
current designated positions detected by the designated 
position detector. 

According to another aspect, the present invention 
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which achieves these objects relates to an operation 
apparatus and includes a path detector for detecting paths 
of a plurality of concurrently moving designated positions, 
a designation interpreter for interpreting a designation 
5 represented by a combination of the paths of the plurality 
of designated positions detected by the path detector, and 
an operation unit for performing an operation based on the 
designation interpreted by the designation interpreter. 
According to still another aspect, the present 

10 invention which achieves these objects relates to a position 
information processing method and includes a first detecting 
step of concurrently detecting a plurality of designated 
positions, a second detecting step of concurrently detecting 
a plurality of designated positions subsequent to the first 

15 input detecting step, and a travel path recognition step of 
recognizing the travel paths of the plurality of the 
designated positions based on the plurality of preceding 
designated positions detected in the first detecting step 
and the plurality of current designated positions detected 

2 0 in the second detecting step. 

According to yet another aspect, the present invention 
which achieves these objects relates to an operational 
method and includes a path detecting step of detecting paths 
of a plurality of concurrently moving designated positions, 

25 a designation interpreting step of interpreting a 




- 4 - 

designation represented by a combination of the paths of the 
plurality of designated positions detected in the path 
detecting step, and an operation step of performing an 
operation based on the designation interpreted by the 
5 designation interpreting step. 

According to another aspect, the present invention 
which achieves these objects relates to a computer-readable 
storage medium storing a position information processing 
program for controlling a computer to perform processing of 

10 position information. The program includes codes for 

causing the computer to perform a first detecting step of 
concurrently detecting a plurality of designated positions, 
a second detecting step of concurrently detecting a 
plurality of designated positions, and a travel path 

15 recognition step of recognizing the travel paths of the 

plurality of the designated positions based on the plurality 
of preceding designated positions detected in the first 
detecting step and the plurality of current designated 
positions detected in the second detecting step. 

2 0 According to another aspect, the present invention 

which achieves these objects relates to a computer-readable 
storage medium storing a manipulation program for 
controlling to perform manipulation. The program comprising 
codes for causing the computer to perform a path detecting 

25 step of detecting paths of a plurality of concurrently 
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moving designated positions, a designation interpreting step 
of interpreting a designation represented by a combination 
of the paths of the plurality of designated positions 
detected in the path detecting step, and an operation step 
5 of performing an operation based on the designation 
interpreted by the designation interpreting step. 

Other objects and advantages besides those discussed 
above shall be apparent to those skilled in the art from the 
description of a preferred embodiment of the invention which 

10 follows. In the description, reference is made to 

accompanying drawings, which form a part thereof, and which 
illustrate an example of the invention. Such example, 
however, is not exhaustive of the various embodiments of the 
invention, and therefore reference is made to the claims 

15 which follow the description for determining the scope of 
the invention. 

Further objects, features and advantages of the present 
invention will become apparent from the following 
description of the preferred embodiments with reference to 
20 the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing the hardware 
25 structure of an information processing apparatus of one 



embodiment ; 

FIGS. 2A-2C show an example of position inputting using 
a finger on a touch panel; 

FIG. 3 shows an example of position inputting using a 
finger on an image pickup device; 

FIG. 4 is a flow diagram showing a process of using a 
path of a designated position; 

FIG. 5 is a flow diagram showing a process of a path 
detection; 

FIG. 6 is a flow diagram showing a combination 
determination process; 

FIGS. 7A-7C show stored designated position data; 

FIGS. 8A and 8B show current designated position data; 

FIGS. 9A-9D show a flow of data that is used in the 
detection of paths of a plurality of designated positions; 

FIG. 10 is a flow diagram showing a path detection 
process using the size of a designated area; 

FIG. 11 is a flow diagram showing a combination 
determination process using the designated area; 

FIGS. 12A and 12B show an area of an acquired current 
designated position; 

FIGS. 13A-13D show the data of the area of the stored 
designated positions; 

FIGS. 14A-14D show a flow of data that is used in a 
process based on the size of the designated area; 
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FIG. 15 is a flow diagram showing an operational 
procedure using the paths of a plurality of designated 
positions ; 

FIG. 16 is a flow diagram showing a process flow of a 
5 designation interpretation process; 

FIG. 17 is a flow diagram showing an algorithm for 
acquiring a change in the distance between designated 
positions ; 

FIG. 18 is a flow diagram showing a designation 
10 interpretation process based on the change in the distance 
between the designated positions; 

FIG. 19 is a flow diagram showing another designation 
interpretation process based on the change in the distance 
between the designated positions; 
15 FIGS. 20A and 20B show an operational example that is 

interpreted as a contraction operation; 

FIGS. 21A and 2 IB show the corresponding data samples 
that are interpreted as the contraction operation; 

FIGS. 22A and 22B show an operational example that is 
20 interpreted as an expansion operation; 

FIGS. 23A and 23B show the corresponding data samples 
that are interpreted as the expansion operation; 

FIG. 24 is a flow diagram showing a designation 
interpretation process using a change in the angle of 
25 designated positions; 




FIG. 25 is a flow diagram showing an algorithm for 
acquiring the change in the angle of the designated 
position; 

FIG. 26 is a flow diagram showing a designation 
5 interpretation process based on the angle change; 

FIGS. 27A and 27B show an operational example that is 
interpreted as a clockwise rotation operation; 

FIGS. 2 8A and 28B show the corresponding data samples 
that are interpreted as the clockwise rotation operation; 
10 FIGS. 2 9A and 29B show an operational example that is 

interpreted as a counterclockwise rotation operation; 

FIGS. 30A and 30B show the corresponding data samples 
that are interpreted as the counterclockwise rotation 
operation; 

15 FIG. 31 is a flow diagram showing a designation 

interpretation process that uses a relationship between a 
designated fixed position and a designated moving position 

FIG. 32 is a flow diagram showing a designated fixed 
position detection process; 

20 FIG. 33 is a flow diagram showing a designation 

interpretation process based on the direction of travel; 

FIG. 34 is a flow diagram showing a process of 
determining the direction of travel of a designated 
position; 

25 FIG. 35 illustrates the interpretation of angles used 
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in the designated position travel direction determination 
process; 

FIGS. 36A and 36B show an operational example that is 
interpreted as a leftward shifting operation; 
5 FIGS. 37A-37D show the corresponding data samples that 

are interpreted as the leftward shifting operation; 

FIGS. 38A and 3 8B show an operational example that is 
interpreted as an upward shifting operation; 

FIGS. 39A-39D show the corresponding data samples that 
10 are interpreted as the upward shifting operation; 

FIGS. 40A and 40B show an operational example that is 
interpreted as a downward shifting operation; 

FIGS. 41A-41D show the corresponding data samples that 
are interpreted as the downward shifting operation; 
15 FIGS. 42A and 42B show an operational example that are 

interpreted as a rightward shifting operation; 

FIGS. 43A-43D show the corresponding data samples that 
are interpreted as the rightward shifting operation; 

FIG. 44 is a flow diagram showing a designation 
20 interpretation process that uses a change in the distance 

between a designated fixed position and a designated moving 
position; 

FIG. 45 is a flow diagram showing a designation 
interpretation process that uses the change in the distance 
2 5 between the designated positions; 
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FIGS. 4 6A and 46B show an operational example that is 
interpreted as a contraction operation; 

FIGS. 47A-47D show the corresponding data samples that 
are interpreted as the contraction operation; 
5 FIGS. 48A and 48B show an operational example that is 

interpreted as an expansion operation; 

FIGS. 4 9A-4 9D show the corresponding data samples that 
is interpreted as the expansion operation; 

FIGS. 50A and 50B show an operational example that is 
10 interpreted as a contraction operation centered on a 
designated fixed position; 

FIGS. 51A-51F show the corresponding data samples that 
is interpreted as the contraction operation centered on the 
designated fixed position; 
15 FIG. 52 is a flow diagram showing an algorithm that 

uses a distance between designated moving positions; 

FIG. 53 is a flow diagram showing a designation 
interpretation process based on a change in the distance 
between the designated moving positions; 
20 FIGS. 54A and 54B show an operational example that is 

interpreted as a contraction operation; 

FIGS. 55A-55E show the corresponding data samples that 
are interpreted as the contraction operation; 

FIGS. 56A and 56B show an operational example that is 
25 interpreted as an expansion operation; 
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FIGS. 57A-5 7E show the corresponding data samples that 
are interpreted as the expansion operation; 

FIGS. 58A and 58B show an operational example that are 
interpreted as an operation for moving a plurality of 
5 positions; 

FIGS. 59A-59H show the corresponding data samples that 
are interpreted as the operation for moving the plurality of 
positions ; 

FIG. 60 is a flow diagram of an algorithm that uses a 
10 change in an angle of the designated positions; 

FIG. 61 is a flow diagram showing a designation 
interpretation process based on the change in the angle of 
the designated positions; 

FIGS. 62A and 62B show an operational example that is 
15 interpreted as a clockwise rotation operation; 

FIGS. 63A-63D show the corresponding data samples that 
are interpreted as the clockwise rotation operation; 

FIGS. 64A and 64B show an operational example that is 
interpreted as a counterclockwise rotation operation; 
2 0 FIGS. 65A-65D show the corresponding data samples that 

are interpreted as the counterclockwise rotation operation; 

FIG. 66 is a flow diagram of an algorithm that uses a 
change in an angle of designated moving positions; 
FIG. 67 is a flow diagram of a designation 
25 interpretation process based on the change in the angle of 
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the designated moving positions; 

FIGS. 68A and 68B show an operational example that is 
interpreted as a clockwise rotation operation; 

FIGS. 69A-69E show the corresponding data samples that 
5 are interpreted as the clockwise rotation operation; 

FIGS. 70A and 70B show an operational example that is 
interpreted as a counterclockwise rotation operation; 

FIGS. 71A-71E show the corresponding data samples that 
are interpreted as the counterclockwise rotation operation; 
10 FIGS. 72A and 72B show an operational example that is 

interpreted as a rotation operation about the center of 
gravity; 

FIGS. 73A-73H show the corresponding data samples that 
are interpreted as the rotation operation about the center 
15 of gravity; 

FIG. 74 is a flow diagram showing an algorithm that 
uses a positional relationship between designated positions; 

FIG. 75 is a flow diagram showing an algorithm for 
determining a positional relationship between designated 
20 positions; 

FIG. 76 is a flow diagram showing a designation 
interpretation process based on the positional relationship 
between the designated positions; 

FIG. 7 7 shows an operational example that is 
25 interpreted as a vertical shifting operation; 
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FIGS. 78A-78D show the corresponding data samples that 
are interpreted as the vertical shifting operation; 

FIGS. 79A and 79B show an operational example that is 
interpreted as a lateral shifting operation; 
5 FIGS. 80A-80D show the corresponding data samples that 

are interpreted as the lateral shifting operation; 

FIG. 81 is a flow diagram showing a designation 
interpretation process based on a positional relationship 
between designated positions; 
10 FIG. 82 is a flow diagram showing a designation 

interpretation process based on the positional relationship 
between the designated positions; 

FIG. 83 is a flow diagram showing an algorithm for 
acquiring a change in the positional relationship between 
15 the designated positions; 

FIGS. 84A and 84B show an operational example that is 
interpreted as an inversion operation; 

FIGS. 85A-85D show the corresponding data samples that 
are interpreted as the inversion operation; 
2 0 FIGS. 86A and 86B show an operational example that is 

interpreted as a lateral inversion operation; 

FIGS. 87A-87D show the corresponding data samples that 
are interpreted as the lateral inversion operation; 

FIGS. 88A and 88B show an operational example that is 
25 interpreted as a vertical inversion operation; 
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FIGS. 89A-89D show the corresponding data samples that 
are interpreted as the vertical inversion operation; 

FIG. 90 is a flow diagram showing an algorithm for 
determining a positional relationship between designated 
5 positions; 

FIG. 91 is a flow diagram of a designation 
interpretation process based on the positional relationship 
to the designated fixed position; 

FIG. 92 is a flow diagram showing in detail the 
10 designation interpretation process based on the positional 
relationship to the designated fixed position; 

FIG. 93 is a flow diagram showing an algorithm for 
determining the positional relationship to the designated 
fixed position; 

15 FIG. 94 is a flow diagram showing an algorithm for 

acquiring the direction of travel of a designated position; 

FIGS. 95A and 95B show two operational examples that 
have different interpretations depending on the positional 
relationship of designated positions even though the travel 
20 directions thereof are the same; 

FIGS. 9 6A-9 6D show the corresponding data samples that 
are interpreted as a next-item operation; 

FIG. 97 is a flow diagram showing an algorithm for 
determining a positional relationship between designated 
25 fixed positions and a designated moving position; 
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FIG. 98 is a flow diagram showing an algorithm for 
determining a positional relationship between designated 
positions; 

FIG. 99 is a flow diagram showing an algorithm for 
5 determining the positional relationship between the 
designated positions; 

FIG. 100 is a flow diagram showing an algorithm for 
acquiring a change in the positional relationship between 
the designated positions; 
10 FIG. 101 is a flow diagram showing a designation 

interpretation process based on the positional relationship 
between the designated fixed positions and the designated 
moving position; 

FIGS. 102A and 102B show an operational example that is 
15 interpreted as a symmetrical inversion operation; 

FIGS. 103A-103E show the corresponding data samples 
that are interpreted as the symmetrical inversion operation; 

FIG. 104 is a flow diagram showing an algorithm for at 
least three designated fixed positions; 
20 FIG. 105 is a flow diagram of a process for determining 

a positional relationship of a designated moving position 
with respect to a plurality of designated fixed positions; 

FIG. 106 is a flow diagram of a process for acquiring 
the positional relationship between the designated 
25 positions; 
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FIG. 107 shows an operational example which is 
interpreted to mean that the designated moving position is 
within an area defined by the designated fixed positions; 

FIGS. 108A-108F show the corresponding data samples 
5 which are interpreted to mean that the designated moving 
position is within the area defined by the designated fixed 
positions ; 

FIG. 109 is a flow diagram showing an algorithm for 
acquiring the positional relationship between the designated 
10 positions; 

FIG. 110A and HOB show an operational example which is 
interpreted as a shifting operation from within an area; 

FIGS. 111A-111F show the corresponding data samples 
which are interpreted to mean the shifting operation from 
15 within the area; 

FIG. 112 is a flow diagram showing a designation 
interpretation process based on the positional relationship 
of a designated moving position to a plurality of designated 
fixed positions; 

20 FIGS. 113A and 113B show an operational example that is 

interpreted to mean that an attribute is imparted to the 
area defined by the designated fixed positions; 

FIGS. 114A-114F show the corresponding data samples 
that are interpreted to mean that the attribute is imparted 

2 5 to the area defined by the designated fixed positions; 



FIG. 115 is a flow diagram showing a designation 
interpretation process based on a change in the count of a 
plurality of designated positions; 

FIG. 116 is a flow diagram showing a designation 
5 interpretation process based on a change in the initial 
count of designated positions; 

FIGS. 117A and 117B show an operational example that is 
interpreted to mean that the designation of an object to be 
processed is on its way; 
10 FIGS. 118A-118F show the corresponding data samples 

that are interpreted to mean that the designation of the 
object to be processed is on its way; 

FIG. 119 is a flow diagram showing a designation 
interpretation process based on the change in the designated 
15 position count; 

FIG. 12 0 is a flow diagram showing a designation 
interpretation process based on an initial designated 
position; 

FIGS. 12 1A and 12 IB show an operational example that is 
2 0 interpreted as a rotation operation about a designated 
position; 

FIGS. 122A-122D show the corresponding data samples 
which are interpreted as the rotation operation about the 
designated position; 
25 FIG. 123 is a flow diagram showing an algorithm that 



uses a change in the last count of designated positions; 

FIG. 124 is a flow diagram showing a designation 
interpretation process based on the change in the last count 
of the designated positions; 

FIGS. 125A and 125B show an operational example that is 
interpreted as a canceling operation to cancel an 
immediately preceding operation; 

FIGS. 126A-126F show the corresponding data samples 
that are interpreted as the canceling operation to cancel 
the immediately preceding operation; 

FIG. 127 is a flow diagram showing an algorithm that 
uses designated information other than a designated path; 

FIG. 128 is a flow diagram showing an algorithm that 
uses designated information other than a designated path; 

FIG. 129 is a flow diagram showing an algorithm that 
uses the count of all designated positions; 

FIG. 13 0 is a flow diagram showing a designation 
interpretation process based on the designated position 
count; 

FIGS. 131A and 13 IB show an operational example that is 
interpreted as a page-turning operation; 

FIGS. 132A-132H show the corresponding data samples 
that are interpreted as the page-turning operation; 

FIG. 133 is a flow diagram showing an algorithm for 
acquiring the speed of travel of a designated position as 
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the designated position information other than the 
designated path; 

FIG. 134 is a flow diagram showing an algorithm for 
acquiring the speed of travel of the designated position; 
5 FIG. 135 is a flow diagram showing a designation 

interpretation process based on the designated position 
travel speed; 

FIGS. 13 6A-136D show an operational example that is 
interpreted as a page-turning using the designated position 
10 travel speed; 

FIGS. 137A-137G show the corresponding data samples 
that are interpreted as the page- turning using the 
designated position travel speed; 

FIG. 138 is a flow diagram showing an algorithm that 
15 uses a contact pressure at a designated position as the 
designated information other than the designated path; 

FIG. 139 is a flow diagram showing a designation 
interpretation process based on the designated position 
contact pressure; 
2 0 FIGS. 14 0A-140D show an operational example that is 

interpreted as a screen shifting operation in response to 
the designated position contact pressure; 

FIGS. 141A-141H show the corresponding data samples 
that are interpreted as the screen shifting operation in 
25 response to the designated position contract pressure; 



FIG. 142 is a flow diagram showing an algorithm that 
uses the distances of travel of a plurality of designated 
positions ; 

FIG. 143 is a flow diagram showing a designation 
interpretation process based on the distances of travel of 
the plurality of designated positions; 

FIGS. 144A-144D show an operational example that is 
interpreted as a page-turning operation in response to the 
distances of travel of the plurality of designated 
positions ; 

FIGS. 145A-145G show the corresponding data samples 
that are interpreted as the page-turning operation in 
response to the distances of travel of the plurality of 
designated positions? 

FIG. 146 is a flow diagram showing an algorithm that 
uses stationary times of a plurality of designated 
positions ; 

FIGS. 147A and 147B show an operational example that 
interpreted as an area designating operation; 

FIGS. 14 8A-148D show the corresponding data samples 
that are interpreted as the area designating operation; 

FIGS. 149A and 149B show an operational example that 
interpreted as an expansion operation to be effected on a 
designated area; and 

FIGS. 150A-150D show the corresponding data samples 
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that are interpreted as the expansion operation to be 
effected on the designated area. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 

Preferred embodiments of the present invention are 
discussed, referring to the drawings. 

FIG. 1 is a block diagram showing the hardware 
structure of an information processing apparatus of one 
10 embodiment of the present invention. 

As shown, for example, an input module 1 is a touch 
panel for receiving information by a position designation. 
A CPU 2, performing computation and logical determination 
for a variety of processes, controls elements connected to a 
15 bus 6. An output module 3 is a display for displaying 

information thereon, a printer for printing out information, 
or a modem for transmitting information. 

A program memory 4 stores programs which are executed 
by the CPU 2, as will be discussed in detail with reference 
20 to flow diagrams. The program memory 4 may be a ROM (Read- 
only Memory) or a RAM (Random Access Memory) into which 
programs are transferred from an external storage device. 

A data memory 5 stores data that is created in the 
course of each process, and knowledge base, as will be 
25 discussed later. The data memory 5 may be a RAM. The 
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knowledge base may be preloaded from a nonvolatile external 
storage device, or may be referenced in time of need. 

The bus 6 transfers an address signal designating an 
element that is to be controlled by the CPU 2, a control 
signal for controlling each element, and data to be 
exchanged the elements . 

First embodiment 

FIGS. 2A-2C show an example of position inputting using 
a finger on a touch panel. As shown, the information 
processing apparatus knows an input by acquiring the paths 
extending between the start points and the end points of two 
paths A and B at which fingers touch. 

In an example 1 of travel of designated position points 
in a parallel direction, the distance between the two points 
remain unchanged, and the resulting paths are parallel. 
This example may be used to translate an object. 

In an example 2 of travel of designated position points 
in an inward direction, the two points approach each other 
in the paths thereof. This example may be used to contract 
or minimize an object. 

In an example 3 of travel of designated position points, 
the two points move away from each other in the paths 
thereof. This example may be used to expand or maximize an 
object. 
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FIG. 3 shows an example of position inputting using a 
finger on an image pickup device. Instead of directly 
touching the touch panel with the fingers, a user moves the 
fingers as represented by signs 303 and 304 within a 
effective field 302 of a camera 301. The apparatus 
recognizes a pointed location (at the finger tip), thereby 
detecting a designated position point. 

FIG. 4 is a flow diagram showing a process of using a 
path of a designated position point. As shown, an input is 
sensed in step S401. When the end of the input remains 
undetected, the algorithm proceeds to step S403. A path 
detection process is thus initiated. In succession, in step 
S404, a process in response to a detected path as input 
information is initiated. 

FIG. 5 is a flow diagram showing the path detection 
process performed in step S403. In step S501, a designated 
position detection process is executed to acquire coordinate 
data of current designated position points. In step S502, a 
combination determination process is performed to determine 
combinations of current designated position points and 
immediately preceding designated position points 
respectively closest thereto. In step S503, a designated 
position storage process is executed to store the current 
designated position point in an optimum designated position 
table (i.e., the same table in which the immediately 
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preceding position closest thereto is stored). 

FIG. 6 is a flow diagram showing a combination 
determination process in step S502. As shown, step S601 
performs a process for determining a distance between one of 
the current designated position points and each of the 
immediately preceding designated position points. In step 
S602, a combination of the current designated position point 
and the immediately preceding designated position point 
closest thereto is determined. When such a combination is 
found in step S603, the algorithm proceeds to step S604. 
The current designated position point is then added to the 
table that stores the immediately preceding designated 
position point to be combined therewith. This series of 
steps is repeated until no further combination is found in 
step S603. 

FIGS. 7A-7C show stored current designated position 
data that is stored in the path detection process. As shown 
in a graph 701, the XY coordinates of a point Atj are (3,3) 
at time t lf and the XY coordinates of a point At 5 are (7,5) 
at time t 5 . Tables 7 02 and 703 respectively store the 
coordinate data of the points A and B taken at time points 
from t x to t 5 . 

FIGS. 8A and 8B show current designated position data 
that is acquired in the path detection process. As shown in 
a graph 801, there are a plurality of designated position 
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points at time t 6 : a point a having XY coordinates (8,6) and 
a point b having XY coordinates (8,8). A table 802 stores 
the position data currently acquired (at time t 5 ). 

FIGS. 9A-9D show a flow of data that is used in the 
detection of paths of a plurality of designated position 
points. As shown, a table 901 stores the point a (8,6) and 
the point b (8,8) as the current designated data. 
Referencing the current designated position data, a distance 
is calculated from each of the current designated position 
points to each of the immediately preceding designated 
position points. For example, the apparatus determines a 

distance of 1.414 from the point a to the immediately 
preceding designated position point At 5 and a distance of 
4.123 from the point a to the immediately preceding 
designated position point Bt 5 . 

As a result, the point a is stored in a table 903 which 
stores the immediately preceding designated position point 
At s closest thereto. Similarly, the point b is stored in a 
table 904 which stores the immediately preceding designated 
position point Bt s closest thereto. 

FIG. 10 is a flow diagram showing a path detection 
process using the size of a designated area. In the above 
process, the path is determined based on the assumption that 
each of the current designated position points is linked to 
one of the immediately preceding designated position points 



closest thereto. Here, a path is determined based on the 
assumption that each of the current designated position 
points is linked to one of the plurality of preceding 
designated position points having a designated area (for 
example, a contact area by a finger on a touch panel) 
closest in size to the area of the current designated 
position point. 

As shown, a designated area detection process is 
initiated to acquire the current designated area in step 
S1001. In step S1002, a combination determination process 
is initiated to determine a combination of the current 
designated area and the immediately preceding designated 
area closest thereto based on a difference between the 
current designated area and the immediately preceding 
designated area. In step S1003, a designated-area storage 
process is initiated in step S1003 to store the current 
designated area in an optimum table (i.e., the table that 
stores the immediately preceding designated area closest to 
the current designated area) . 

FIG. 11 is a flow diagram showing the combination 
determination process using the size of the designated area 
in step S1002. As shown, in step S1101, a process is 
initiated to determine a difference between the current 
designated area and the immediately preceding designated 
area. In succession, step S1102 determines a combination of 



the current designated area and the immediately preceding 
designated area closest in size thereto. The algorithm 
proceeds to step SI 104 when any combination is found in step 
S1103. The current designated position point and the area 
thereof are added to the table of the immediately preceding 
designated position point and the area thereof respectively 
closest in position and size thereto. This series of 
process steps is repeated until no further combinations are 
found in the step S1103. 

FIGS. 12A and 12B show an area of an acquired current 
designated position point. In a graph 1201, the current 
designated position is the point a(8,6). An enlarged view 
1202 shows the touch state of the touch panel when the point 
a is pressed. The area of the designated position point is 
thus determined. 

FIGS. 13A-13D show the data of the area of the stored 
designated positions. As shown, in a graph 13 01 at time t ir 
the XY coordinates of the designated position point A^ are 
(3,3) and the XY coordinates of the designated position 
point Bt x are (12, 14). At time t 5/ the XY coordinates of 
the designated position point At 5 are (7,5) and the XY 
coordinates of the designated position point Bt 5 is (8,8). 
There also exist a current designated area 1 containing the 
point a(8,6) and a current designated area 2 containing the 
point b(8,8) at time t 6 . 
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In a table 1302, the area A of the point a is 12.5 at 
time tl, and the area data of the point a at subsequent time 
points between time t x and time t 5 are also stored in the 
table 1302. Similarly, the data of the area B of the point 
b at each time point is stored in a table 1303. A table 
1304 stores an area of 11.5 containing the point a and an 
area of 2 0.0 containing the point b as the acquired 
designated data at current time t 6 . 

FIGS. 14A-14D show a flow of data that is used in a 
path acquisition process based on the size of the designated 
area. As shown, a table 1401 lists, as the current 
designated area data, an area of 11.5 containing the point 
a (8, 6) and an area of 20.0 containing the point b(8,8). 
Referencing the current designated area data, the apparatus 
acquires a difference between the current designated area 
data and the immediately preceding area data and stores the 
difference in a table 1402. With respect to the designated 
area 11.5 containing the point a, the apparatus thus 
acquires a difference of 0.5 from the immediately preceding 
area A and a difference of 9.0 from the immediately 
preceding area B. 

The designated area data 11.5 containing the point a is 
thus stored in a table 1403 that stores the immediately 
preceding area A that results in the minimum difference. 
Similarly, the designated area data containing the point b 
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is stored in a table 14 04 that stores the immediately 
preceding designated area B. 

Second embodiment 

A second embodiment of the present invention is 
discussed. In the second embodiment, a process for 
interpreting an operation to perform is based on a 
combination of travel paths of at least two designated 
position points - 

FIG. 15 is a flow diagram showing an operational 
procedure using the paths of a plurality of designated 
position points. An input is detected in step S1501. The 
algorithm proceeds to step S1502. When the end of the input 
remains undetected in step S1502, the algorithm proceeds to 
step S1503, thereby initiating a travel path detection 
process. In step S1504, a designation interpretation 
process is performed, and in step S1505, a process in 
response to the designation is initiated. 

FIG. 16 is a flow diagram showing a process flow of the 
designation interpretation process in the step S1504. In 
step S1601, a designated position-to-position distance 
measurement process is initiated to measure a distance 
between current designated position points. In succession, 
step S1602 performs a process for acquiring a change in the 
designated position-to-position distance to acquire the 
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distance change. In step S1603, the designation 
interpretation process based on the distance change is 
performed to interpret an operation to perform based on the 
acquired distance change. 
5 FIG. 17 is a flow diagram showing a process in the step 

S1602 for acquiring the change in the distance between the 
designated position points. In step S1701, a distance 
between the designated position points at the start of a 
travel is measured. In step S1702, a distance between the 
10 designated position points at the end of the travel is 

measured. In succession, step S1703 determines a difference 
between the distance between the designated position points 
at the start of the travel and the distance between the 
designated position points at the end of the travel. 
15 FIG. 18 is a flow diagram showing a designation 

interpretation process in the step S1603 based on the change 
in the distance between the designated position points. 
When the amount of change in the distance is smaller than 
zero in step S1801, the designation is interpreted as a 
20 contraction operation (in step S1802). When the amount of 
change is greater than zero, the designation is interpreted 
as an expansion operation (in step S1803). When the amount 
of change is equal to zero, the designation is interpreted 
as an operation other than the contraction and expansion 
25 operations (in step S1804). 
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FIG. 19 is a flow diagram showing another designation 
interpretation process based on the change in the distance 
between the designated position points. In step S1901, an 
operational magnification is acquired from the distance 
5 change obtained in the process of acquiring the distance 
change between the designated position points. In step 
S1902, the rate of change is acquired, and in step S1903, an 
effective magnification results from the operational 
magnification and rate of change data in accordance with the 
10 following equation. 

Effective magnif ication=100 - ( 100-operational magnification 
X) x rate of change a 

FIGS. 2 OA and 20B show an operational example that is 

15 interpreted as a contraction operation. As shown, 

designated position points A and B at the start time t 1 of a 
travel are respectively shifted to designated position 
points A 1 and B' at the end time t s of the travel. This 
input is interpreted as a contraction operation. 

20 FIGS. 21A and 2 IB show the corresponding data samples 

that are interpreted as the contraction operation. In a 
graph 2101, the XY coordinates of the designated position 
points are At x (3,3) and Bt x (12,10) at the start time t 2 and 
At 5 (7,5) and Bt 5 (8,6) at the end time t 5 of the travel. 

25 Referring to a table 2102, the distance between the 
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designated points is 15.00 at the start time t lf and is 1.118 
at the end time t 5 . The mount of change in the distance 
between the designated position points is -13.882 from the 
start time t x to the end time t 5 . The magnification of the 
5 distance change between the designated position points from 
the start time tl to the end time t 5 is 7%. 

FIGS. 22A and 22B show an operational example that is 
interpreted as an expansion operation. As shown, designated 
position points A and B at the start time t x of a travel are 
10 respectively shifted to designated position points A' and B ' 
at the end time t 5 of the travel. This input is interpreted 
as an expansion operation. 

FIGS. 23A and 23B show the corresponding data samples 
that are interpreted as the expansion operation. In a graph 
15 2301, the XY coordinates of the designated position points 
are At!(7,5) and 3^(8,6) at the start time t L and At 5 (3,3) 
and Bt 5 (12,10) at the end time t 5 of the travel. Referring 
to a table 2302, the distance between the designated points 
at the start time t, is 1.118, and 11.402 at the end time t 5 . 
20 The mount of change in the distance between the designated 
position points is +13.586 from the start time t x to the end 
time t 5 . The magnification of the distance change between 
the designated position points from the start time t 1 to the 
end time t 5 is 1020%. 
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Third embodiment 

A third embodiment of the present invention is now 
discussed. The third embodiment accounts for a change in an 
angle made between a reference line and a line that connects 
two designated positions when an operation to perform is 
interpreted from a combination of travel paths of at least 
two designated positions. The angle made between the 
reference line and the line that connects the two designated 
positions is hereinafter occasionally referred to as the 
designated position angle. 

FIG. 24 is a flow diagram showing a designation 
interpretation process using a change in the angle of 
designated positions. In step S2401, a process for 
measuring the designated position angle is initiated. At 
each time point, the designated position angle is measured. 
The algorithm proceeds to step S2402. An acquisition 
process of acquiring a change in the designated position 
angle is performed, in step S2403, a designation 
interpretation process is initiated to interpret an 
operation to perform based on the acquired angle change. 

FIG. 25 is a flow diagram showing the process for 
acquiring the change in the angle of the designated position. 
In step S2501, an angle of a line connecting the designated 
positions is measured at the start of a travel, and in step 
S2502, an angle of a line connecting the designated 
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positions is measured at the end of the travel. The 
algorithm proceeds to step S2503. A difference between the 
angles of the line connecting the designated position points 
at the start of the travel and the line connecting the 
designated position points at the end of the travel is 
acquired. 

FIG. 2 6 is a flow diagram showing a designation 
interpretation process based on the angle change. When the 
amount of change is greater than zero degree in step S2601, 
the designation is interpreted as a counterclockwise 
rotation operation (in step S2602). When the amount of 
change is smaller than zero degree in the step S2601, the 
designation is interpreted as a clockwise rotation operation 
(in step S2603). When the amount of change equals zero 
degree, the designation is interpreted as an operation other 
than rotation operations (in step S2604). 

FIGS. 27A and 27B show an operational example that is 
interpreted as a clockwise rotation operation. As shown, 
designated position points A and B at the start time t, of 
the travel are respectively shifted to designated position 
points A ' and B' at the end time t 5 of the travel. This 
input is interpreted as a clockwise rotation operation. 

FIGS. 28A and 28B show the corresponding data samples 
that are interpreted as the clockwise rotation operation. 
In a graph 2801, the angle of the designated position points 



A and B is 60 degrees with respect to the X axis at the 
start time t x of the travel and is 26 degrees with respect to 
the X axis at the end time t 5 of the travel. As listed in a 
table 2802, the amount of change in the angle from the start 
time t a of the travel to the end time t 5 of the travel is - 
34°. 

FIGS. 2 9A and 2 9B show an operational example that is 
interpreted as a counterclockwise rotation operation. As 
shown, designated position points A and B at the start time 
t x of the travel are respectively shifted to designated 
position points A' and B' at the end time t 5 of the travel. 
This input is interpreted as a counterclockwise rotation 
operation . 

FIGS. 30A and 30B show the corresponding data samples 
that are interpreted as the counterclockwise rotation 
operation. In a graph 3 001, the angle of the designated 
position point points A and B is 60 degrees with respect to 
the X axis at the start time t x of the travel and is 87 
degrees with respect to the X axis at the end time t 5 of the 
travel. As listed in a table 3002, the amount of change in 
the angle from the start time t x of the travel to the end 
time t 5 of the travel is +2 7°. 

Fourth embodiment 

A fourth embodiment of the present invention is now 



discussed. The fourth embodiment accounts for a change in a 
relationship between a designated fixed position and a 
designated moving position when an operation to perform is 
interpreted from a combination of travel paths of at least 
two designated position points. 

FIG. 31 is a flow diagram showing a designation 
interpretation process that uses a relationship between a 
designated fixed position and a designated moving position. 
In step S3 101, a designated fixed position detection process 
is initiated to detect a designated fixed position. In 
succession, step S3 102 initiates a designation 
interpretation process in response to the designated fixed 
position to interpret an operation to perform. 

PIG. 32 is a flow diagram showing the designated fixed 
position detection process. When the designated fixed 
position detection process is initiated, a designated 
position at time t is detected in step S3201. When position 
data is present in step S3202, the algorithm proceeds to 
step S3203 to compare the current designated position with 
an initial value of the designated position. When both are 
unmatched, the designated position is determined to be as 
being shifted in step S3204. When the designate position at 
time t matches the initial value thereof, the algorithm 
proceeds to step S3 2 05 to advance time t, and then the above 
series of steps starts again with the step S3201. When no 
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position data is available in the step S3202, the designated 
position is determined to be fixed, and the designated fixed 
position is then detected. 

FIG. 33 is a flow diagram showing a designation 
5 interpretation process based on the direction of travel. In 
step S3301, a process is initiated to determine the travel 
direction of the designated position. In step S3302, an 
operation to perform is interpreted based on the determined 
travel direction of the designated position. 

10 When the travel direction is upward, the algorithm 

proceeds to step S3303, thereby interpreting the designation 
as a next-item operation. Besides the next-item operation, 
the designation may be interpreted as one of a next-page 
operation, a next-screen operation, a last-line operation, 

15 an upward shifting operation, an expansion operation in a 
vertical direction only, and a contraction operation in a 
vertical direction only. When the travel direction is 
downward, the algorithm proceeds to step S3304, thereby 
interpreting the designation as one of a preceding-item 

2 0 operation. Besides the preceding-item operation, the 

designation may be interpreted as a preceding-page operation, 
a preceding-screen operation, a first-line operation, a 
downward shifting operation, an expansion operation in a 
vertical direction only, and a contraction operation in a 

25 vertical direction only. 



When the travel direction is leftward, the algorithm 
proceeds to step S3 3 05, thereby interpreting the designation 
as a next-item operation. Besides the next-item operation, 
the designation may be interpreted as one of a next-page 
operation, a next-screen operation, a last-line operation, a 
leftward screen shifting operation, an expansion operation 
in a lateral direction only, and a contraction operation in 
a lateral direction only. When the travel direction is 
rightward, the algorithm proceeds to step S3306, thereby 
interpreting the designation as a preceding- item operation. 
Besides the preceding-item operation, the designation may be 
interpreted as one of a preceding-page operation, a 
preceding-screen operation, a first-line operation, a 
rightward screen shifting operation, an expansion operation 
in a lateral direction only, and a contraction operation in 
a lateral direction only. 

FIG. 34 is a flow diagram showing the process of 
determining the direction of travel of the designated 
position point in step S3301. In step S3401, the distance 
of travel of the designated position point is acquired in 
step S3401. In step S3402, the direction of travel is 
determined from the current coordinates of the designated 
moving position. In this case, the arctangent of the 
current coordinates (X,Y) of the designated moving position 
is determined and the unit of measure is converted from 
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radian to degree. 

FIG. 35 illustrates the interpretation of angles used 
in the designated position travel direction determination 
process. As shown in a diagram 3501, the angle range of 360° 
5 is divided into two zones with respect to the x axis: one 
zone ranges from 0° to 180° in the positive Y axis area and 
the other ranges from -1° to -179° in the negative Y axis 
area. 

An angle segment having a range of ±35° (from -35° to 

10 35°) with respect to 0° is interpreted as a rightward 

direction range. An angle segment having a range of ±35° 
(from 55° to 125°) with respect to 90° is interpreted as an 
upward direction range. An angle segment having a range of 
±35° (from 145° to 180° and from -179° to -145°) with respect 

15 to 180° is interpreted as a leftward direction range. An 
angle segment having a range of ±35° (from -55° to -125°) 
with respect to -90° is interpreted as a downward direction 
range. Angle ranges of ±10° respectively with respect to 45°, 
135°, -135°, and -45° are used for other operations. 

20 FIGS. 36A and 36B show an operational example that is 

interpreted as a leftward shifting operation. When the 
designated position point A is fixed with the designated 
position point B being moved from Bt x to Bt 5/ the input is 
designated as a leftward shifting operation. 

25 FIGS. 37A-37D show the corresponding data samples that 



are interpreted as the leftward shifting operation. As 
shown in a graph 3701, the designated fixed position has the 
coordinates thereof at point A(3,3). The designated moving 
position has the coordinates thereof at point 6^(6,3) at 
travel start time t x and at point Bt 5 (4,2) at travel end time 
t 5 . Tables 3702 list position data of the designated fixed 
position point A and the designated moving position point B 
from time tj. to time t 5 . A table 3703 lists designated 
position travel data. The travel distance of the designated 
fixed position point A at the travel end time t 5 is zero. 
The designated moving position point B has a distance of 
travel of 2.23 6 and a direction of travel of -135.43°. 

FIGS. 38A and 38B show an operational example that is 
interpreted as an upward shifting operation. As shown, the 
designated position point A is fixed while the designated 
position point B is being moved from B^ to Bt 5 . This input 
is interpreted as an upward shifting operation. 

FIGS. 39A-39D show the corresponding data samples that 
are interpreted as the upward shifting operation. As shown 
in a graph 3901, the designated fixed position has the 
coordinates thereof at point A(6,6). The designated moving 
position has the coordinates thereof at point 6^(5,1) at 
travel start time J t 1 and at point Bt 5 (7,4) at travel end time 
t 5 . Tables 3902 list position data of the designated fixed 
position point A and the designated moving position point B 
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from time t x to time t 5 . A table 3903 lists designated 
position travel data- The travel distance of the designated 
fixed position point A at the travel end time t 5 is zero. 
The designated moving position point B has a distance of 
5 travel of 3.603 and a direction of travel of -56.31°. 

FIGS. 4 OA and 4 OB show an operational example that is 
interpreted as a downward shifting operation. As shown, the 
designated position point A is fixed while the designated 
position point B is being moved from Bt x to Bt 5 . This input 
10 is interpreted as a downward shifting operation. 

FIGS. 41A-41D show the corresponding data samples that 
are interpreted as the downward shifting operation. As 
shown in a graph 4101, the designated fixed position A has 
the coordinates thereof at point A(3,3). The designated 
15 moving position B has the coordinates thereof at point 

8^(5,8) at travel start time t x and at point Bt 5 (5,5) at 
travel end time t 5 . Tables 4102 list position data of the 
designated fixed position point A and the designated moving 
position point B from time ■t 1 to time t 5 . A table 4103 lists 
20 designated position travel data. The travel distance of the 
designated fixed position point A at the travel end time t 5 
is zero. The designated moving position point B has a 
distance of travel of 3.000 and a direction of travel of - 
90°. 

25 FIGS. 42A and 42B show an operational example that are 
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interpreted as a rightward shifting operation. As shown, 
the designated position point A is fixed while the 
designated position point B is being moved from Bt 1 as shown 
FIG. 42A to Bt 5 as shown in FIG. 42B. This input is 
5 interpreted as a rightward shifting operation. 

FIGS. 43A-43D show the corresponding data samples that 
are interpreted as the rightward shifting operation, as 
shown in a graph 43 01, the designated fixed position A has 
the coordinates thereof at point A(6,6). The designated 

10 moving position B has the coordinates thereof at point 

Bt!(2,6) at travel start time t L and at point Bt 5 (5,5) at 
travel end time t 5 . Tables 4302 list position data of the 
designated fixed position point A and the designated moving 
position point B from time t x to time t 5 . A table 4303 lists 

15 designated position travel data. The travel distance of the 
designated fixed position point A at the travel end time t 5 
is zero. The designated moving position point B has a 
distance of travel of 3.162 and a direction of travel of - 
18.43°. 

20 

Fifth embodiment 

A fifth embodiment of the present invention is now 
discussed. The fifth embodiment accounts for a change in a 
distance between a designated fixed position and a 
25 designated moving position when an operation to perform is 
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interpreted from a combination of travel paths of at least 
two designated positions. 

FIG. 44 is a flow diagram showing a designation 
interpretation process that uses the change in the distance 
between the designated fixed position and the designated 
moving position. A process is initiated to measure the 
distance between the designated fixed position and the 
designated moving position in step S4401. In step S4402, a 
process of acquiring a change in the designated position-to- 
position distance is performed to acquire the distance 
change. In step S4403, the designation interpretation 
process is initiated based on the acquired distance change, 
thereby interpreting what operation to perform. 

FIG. 45 is a flow diagram showing, in step S4403, the 
designation interpretation process that uses the change in 
the distance between the designated positions. The amount 
of change is determined in step S4501. When the amount of 
change is found to decrease, the input is interpreted as a 
contraction operation (in step S4502). When the amount of 
change is found to increase, the input is interpreted as an 
expansion operation (in step S4503). 

FIGS. 46A and 46B show an operational example that is 
interpreted as a contraction operation. As shown, the 
designated position point A is fixed while the designated 
position point B is being moved from Bt 1 to Bt 5 toward the 
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designated fixed position A. This input is interpreted as a 
contraction operation. 

FIGS. 47A-47D show the corresponding data samples that 
are interpreted as the contraction operation. As shown in a 
5 graph 47 01 , the designated fixed position A has the 

coordinates thereof at point A(3 / 3). The designated moving 
position B has the coordinates thereof at point Bt 1 ( 6 , 3 ) at 
travel start time t : and at point Bt 5 (4,2) at travel end time 
t 5 . Tables 4702 list position data of the designated fixed 
10 position point A and the designated moving position point B 
from time t x to time t 5 . A table 4703 lists data of a change 
in the distance between the designated positions. The 
position-to-position distance between the points A and B is 
3.000 at the travel start time t x and is 1.414 at the travel 
15 end time t 5 . The magnification of the position-to-position 
distance between the points A and B is 47% from time t 1 to 
time t 5 . 

FIGS. 48A and 48B show an operational example that is 
interpreted as an expansion operation. As shown, the 
20 designated position point A is fixed while the designated 
position point B is being moved from Bt x to Bt s in a 
direction away from the designated fixed position A. This 
input is interpreted as an expansion operation. 

FIGS. 49A-49D show the corresponding data samples that 
25 are interpreted as the contraction operation. As shown in a 
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graph 4901, the designated fixed position A has the 
coordinates thereof at point A(3,3). The designated moving 
position B has the coordinates thereof at point Bt : (4,2) at 
travel start time t x and at point Bt 5 (6,3) at travel end time 
t 5 . Tables 4902 list position data of the designated fixed 
position point A and the designated moving position point B 
from time t L to time t 5 . A table 4903 lists data of a change 
in the distance between the designated positions. The 
position-to-position distance between the points A and B is 
1.414 at the travel start time tj. and 3.000 at the travel end 
time t 5 . The magnification of the position-to-position 
distance change between the points A and B is 212% from time 
t x to time t 5 . 

FIGS. 50A and 50B show an operational example that is 
interpreted as a contraction operation centered on a 
designated fixed position. As shown, the designated 
position A is fixed. As shown, a designated fixed position 
A remains stationary, and designated moving position points 
B and C are respectively moved from and Ct x to Bt s and Ct 5 . 

This input is interpreted as a contraction operation toward 
the designated fixed position point A. 

FIGS. 51A-51F show the corresponding data samples that 
is interpreted as the contraction operation centered on the 
designated fixed position. As shown in a graph 5101, a 
designated fixed position A has the coordinates thereof at 



point A(3,3). A designated moving position 1 as the point B 
has the coordinates thereof at point 6^(4,8) at travel start 
time t x and at point Bt 5 (5,5) at travel end time t 5 . A 
designated moving position 2 as the point C has the 
coordinates thereof at point 0^(2,2) at the travel start 
time t x and at point Ct 5 (4,3.5) at the travel end time t 5 . 
Tables 5102 list position data of the designated fixed 
position point A, the designated moving position 1 (the 
point B) and the designated moving position 2 (the point c) 
from time J t 1 to time t 5 . 

Tables 5103 list data of the change in the distance 
between the designated positions. In data 1 of the change 
in the designated position-to-position distance, the 
distance between the points A and B is 5.099 at the travel 
start time t x and is 2.828 at the travel end time t 5 . The 
magnification resulting from the position-to-position 
distance change between the points A and B is 55% from time 
t 1 to time t 5 . in data 2 of the change in the designated 
position-to-position distance, the distance between the 
points A and C is 1.414 at the travel start time t 1 and is 
1.118 at the travel end time t 5 . The magnification resulting 
from the position-to-position distance change between the 
points A and C is 7 9% from time t x to time t 5 . 



Sixth embodiment 
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A sixth embodiment of the present invention is now 
discussed. The sixth embodiment accounts for the presence 
of a designated fixed position and a change in a distance 
between designated moving positions when an operation to 
perform is interpreted from a combination of travel paths of 
at least two designated positions. 

FIG. 52 is a flow diagram showing an algorithm that 
uses a distance between designated moving positions, in 
succession to the initiation of a designated fixed-position 
based designation interpretation process, a process of 
acquiring the distance between the designated moving 
positions is initiated in step S5201. In step S5202, a 
process of acquiring the change in the distance between the 
designated moving positions is initiated, thereby acquiring 
the change in the distance. In step S5203, a designation 
interpretation process based on the distance change between 
the designated moving positions is initiated, thus 
interpreting the input based on the amount of change in the 
distance between the designated moving positions. 

FIG. 53 is a flow diagram showing the designation 
interpretation process based on the change in the distance 
between the designated moving positions. When there is a 
designated fixed position in step S5301, the algorithm 
proceeds to step S5302. When the amount of change is 
smaller than zero, the input is interpreted as a contraction 
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operation with respect to the designated fixed position in 
step S5303. When the amount of change is greater than zero, 
the input is interpreted as an expansion operation with 
respect to the designated fixed position in step S5304. 
5 When the amount of change equals zero, the input is 

interpreted as an operation other than the contraction and 
expansion operations in step 5305. When the presence of the 
designated fixed position is not verified in the step S5301, 
the algorithm proceeds to step S5306 and the input is thus 
10 interpreted as an operation effective on the entire screen. 

FIGS. 54A and 54B show an operational example that is 
interpreted as a contraction operation. A designated 
position point A is fixed while two designated moving 
positions Bt 1 and respectively move to Bt 5 and Ct 5 toward 
15 the designated fixed position A. The input is thus 

interpreted as a contraction operation centered on the 
designated fixed position A in accordance with the amount of 
change in the distance between the designated moving 
positions . 

20 FIGS. 55A-55E show the corresponding data samples that 

are interpreted as the contraction operation. In a graph 
5501, the designated fixed position has the coordinates 
thereof at point A(3,3). The designated moving position B 
has the coordinates thereof at point Bt 1 (4,8) at travel start 

25 time t x and at point Bt 5 (5,5) at travel end time t 5 . The 
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designated moving position point C has the coordinates 
thereof at point 0^(3, 2) at the travel start time t x and at 
point Ct 5 (4,2.8) at the travel end time t 5 . 

Tables 5502 list position data of the designated fixed 
position point A, the designated moving position point B, 
and the designated moving position point C from time J t 1 to 
time t 5 . A table 5503 lists data of the change in the 
distance between the designated moving positions, in the 
data of the distance change between the designated moving 
positions, the distance between the designated position 
points B and C is 6.083 at the travel start time t 2 and is 
2.417 at the travel end time t 5 . The magnification resulting 
from the distance change between the designated position 
points B and C is 40% from time t 1 to time t 5 . 

FIGS. 56A and 56B show an operational example that is 
interpreted as an expansion operation centered on the 
designated fixed position. A designated position point A is 
fixed while two designated moving positions Bt x and Ct x 
respectively move to Bt 5 and Ct 5 in a direction away from the 
designated fixed position A. The input is thus interpreted 
as an expansion operation centered on the designated fixed 
position A in accordance with the amount of change in the 
distance between the designated moving positions. 

FIGS. 57A-57E show the corresponding data samples that 
are interpreted as the expansion operation centered on the 



designated fixed position. In a graph 5701, the designated 
fixed position has the coordinates thereof at point A(3,3). 
The designated moving position 1 (the point B) has the 
coordinates thereof at point Bt^S/S) at travel start time t 2 
and at point Bt 5 (4,8) at travel end time t 5 . The designated 
moving position 2 (the point C) has the coordinates thereof 
at point Ct x ( 4,2.8) at the travel start time t x and at point 
Ct 5 (2,2) at the travel end time t 5 . 

Tables 5702 list position data of the designated fixed 
position point A, the designated moving position 1 (the 
point B), and the designated moving position 2 (the point C) 
from time t x to time t 5 . A table 5703 lists data of the 
change in the distance between the designated moving 
positions. In the data 1 of the distance change between the 
designated moving positions, the distance between the 
designated position points B and C is 2.417 at the travel 
start time t x and is 6.325 at the travel end time t s . The 
magnification resulting from the distance change between the 
designated position points B and C is 262% from time t L to 
time t 5 . 

FIGS. 58A and 58B show an operational example that are 
interpreted as an operation for moving a plurality of 
positions with respect to a designated fixed position. As 
shown, a designated position point A is fixed. A designated 
moving position 1, a designated moving position 2 and a 
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designated moving position 3, which are respectively 
positioned at a point Bt 1# . a point Ct ir and a point Dt x as 
shown in FIG. 58A at travel start time t lf are respectively 
moved to a point Bt 5 , a point Ct 5 , and a point Dt 5 as shown 
5 in FIG. 58B toward the designated fixed position A at travel 
end time t 5 . The input is thus interpreted as an operation 
for moving the plurality of designated position points 
toward the designated fixed position A according to the 
amount of change in the distance between the designated 

10 moving positions. 

FIGS. 59A-59H show the corresponding data samples that 
are interpreted as the operation for moving the plurality of 
positions. In a graph 5901 , the designated fixed position 
is placed at coordinates A(3,3). The designated moving 

15 position 1 (the point B) is placed at coordinates Bt 1 (5,5) at 
the travel start time t x and at coordinates Bt 5 (4,8) at the 
travel end time t s . The designated moving position 2 (the 
point C) is placed at coordinates ct 1 (4,3.5) at the travel 
start time t x and at Ct 5 (2,2) at the travel end time t 5 . The 

20 designated moving position 3 (the point D) is placed at 

coordinates Dt 1 (5.5 f 4.5) at the travel start time t x and at 
coordinates Dt 5 (6,9) at the travel end time t 5 . 

Tables 5902 list position data of the designated fixed 
position A, and the three designated moving positions B, C, 

25 and D. Tables 5903 list changes in the distances between 
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the designated moving positions. In data 1 of the distance 

change, the distance between the designated position points 
B and C is 1.803 at the travel start time t lf and is 6.325 at 
the travel end time t 5 . The magnification resulting from the 
5 distance change between the designated positions is 352% 
from time t x to time t 5 . In data 2 of the distance change, 

the distance between the designated position points B and D 
is 0.7 07 at the travel start time t lf and is 2.23 6 at the 
travel end time t s . The magnification resulting from the 

10 distance change between the designated position points is 
316% from time t x to time t 5 . In data 2 of the distance 
change, the distance between the designated position points 
C and D is 1.803 at the travel start time t ir and is 8.062 at 
the travel end time t 5 . The magnification resulting from the 

15 distance change between the designated position points is 
447% from time t x to time t 5 . 

Seventh embodiment 

A seventh embodiment of the present invention is now 

20 discussed. The seventh embodiment accounts for a change in 
an angle made between a horizontal direction and a line that 
connects a designated fixed position and a designated moving 
position when an operation to perform is interpreted from a 
combination of travel paths of at least two designated 

25 position points. The angle is hereinafter referred to as a 
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fixed-to-moving position angle. 

FIG. 60 is a flow diagram of an algorithm that uses a 
change in the angle of the designated fixed and moving 
positions. In step S6001, a process is performed to measure 
the fixed-to-moving position angle. In step S6002, a 
process is performed to acquire a change in the fixed-to- 
moving position angle. In step S6003, a designation 
interpretation process is performed to interpret the input 
based on the acquired angle change. 

FIG. 61 is a flow diagram showing the designation 
interpretation process based on the change in the fixed-to- 
moving position angle. When there is no designated fixed 
position in step S6101, the algorithm proceeds to step S6106. 
The input is interpreted as an operation for the entire 
screen. When any designated fixed position is found in the 
step S6106, the algorithm proceeds to step 6102. When the 
amount of change is smaller than zero degree, the algorithm 
proceeds to step S6104, and the input is interpreted as a 
clockwise rotation operation about the designated fixed 
position. When the amount of change is greater than zero 
degree, the algorithm proceeds to step S6103, and the input 
is interpreted as a counterclockwise rotation operation 
about the designated fixed position. When the amount of 
change equals zero degree, the algorithm proceeds to step 
S6105, and the input is interpreted as an operation other 
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than rotation operations, or a modified operation in a 
rotational direction with the designated fixed position 
stationary . 

FIGS. 62A and 62B show an operational example that is 

5 interpreted as a clockwise rotation operation. As shown, a 
designated position point A is fixed while a designated 
moving position B moves from a point Bt 1 at travel start time 
t! to a point Bt 5 at travel end time t 5 . This input is 
interpreted as a clockwise rotation operation. 

10 FIGS. 63A-63D show the corresponding data samples that 

are interpreted as the clockwise rotation operation. In a 
graph 6301, the angle of the line connecting the designated 
fixed position A and the designated moving position B with 
respect to the horizontal line is 71.57° at the travel start 

15 time t a and is 18.43° at the travel end time t 5 . Tables 6302A 
and 6302B list position data of the designated fixed 
position A and the designated moving position B. A table 
6303 lists angle change data of the designated position 
points, in which the amount of change in the fixed-to-moving 

20 position angle from the travel start time t x to the travel 
end time t 5 is -53.13°. 

FIGS. 64A and 64B show an operational example that is 
interpreted as a counterclockwise rotation operation. As 
shown, a designated position point A is fixed while a 

25 designated moving position B moves from a point Btj at travel 
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start time t x to a point Bt 5 at travel end time t 5 . This 
input is interpreted as a counterclockwise rotation 
operation. 

FIGS. 65A-65D show the corresponding data samples that 
are interpreted as the counterclockwise rotation operation. 
In a graph 6501, the angle of the line connecting the 
designated fixed position A and the designated moving 
position B with respect to the horizontal line is 71.57° at 
the travel start time t x and is 108.43° at the travel end 
time t 5 . Tables 6502A and 6502B list position data of the 
designated fixed position A and the designated moving 
position B. A table 6503 lists angle change data of the 
designated position points, in which the amount of change in 
the fixed-to-moving position angle from the travel start 
time t x to the travel end time t 5 is +3 6.87°. 

Eighth embodiment 

An eight embodiment of the present invention is now 
discussed. The eighth embodiment accounts for a change in 
an angle made between a horizontal direction and a line that 
connects two designated moving positions when an operation 
to perform is interpreted from a combination of travel paths 
of at least two designated position points. The angle is 
hereinafter referred to as a moving-to-moving position angle. 

FIG. 66 is a flow diagram of an algorithm that uses a 
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change in the moving-to-moving position angle. In step 
S6601, a process is performed to measure the moving-to- 
moving position angle. In step S6602, a process is 
performed to acquire a change in the moving-to-moving 
position angle. In step S6603, a designation interpretation 
process is performed to interpret the input based on the 
acquired angle change. 

FIG. 67 is a flow diagram of the designation 
interpretation process based on the change in the moving-to- 
moving position angle. When no designated fixed position is 
found in step S6701, the algorithm proceeds to step S6706. 
The input is then interpreted as an operation effective on 
the entire screen. When a designated fixed position is 
found in the step S6701, the amount of change is checked in 
step S6702. When the amount of change is smaller than zero 
degree, the algorithm proceeds to step S6704, and the input 
is interpreted as a clockwise rotation operation about the 
designated fixed position. When the amount of change is 
greater than zero degree, the algorithm proceeds to step 
S6703, and the input is interpreted as a counterclockwise 
rotation operation about the designated fixed position. 
When the amount of change equals zero degree, the algorithm 
proceeds to step S6705, and the input is interpreted as an 
operation other than rotation operations, otherwise, the 
input is interpreted as a modified operation in a rotation 



direction about the center of gravity of the designated 
moving positions with the designated fixed position 
stationary. 

FIGS. 68A and 68B show an operational example that is 
interpreted as the clockwise rotation operation. As shown, 
a designated position point A is fixed while designated 
moving positions 1 and 2 respectively move from a point Bt 1 
and a point Ct x to a point Bt 5 and a point Ct 5 . This input is 
interpreted as a clockwise rotation operation. 

FIGS. 69A-69E show the corresponding data samples that 
are interpreted as the clockwise rotation operation. In a 
graph 6901, the designated fixed position A has coordinates 
A(3,3). The designated moving position B is placed at 
coordinates Bt 1 (4,6) at the travel start time t x and placed 
at coordinates Bt 5 (6,4) at the travel end time t s . The 
designated moving position C is placed at coordinates 
Ct a (2,l) at the travel start time t x and placed at 
coordinates Ct 5 (l,2) at the travel end time t 5 . Tables 6902 
list position data of the designated fixed position A, the 
designated moving position 1 (the point B) , and the 
designated moving position 2 (the point C) from t t to t 5 . A 
table 6903 lists data of angle change in the moving-to- 
moving position angle. In the angle change data, the 
moving-to-moving position angle is 68.20° at the travel 
start time t x and is 36.87° at the travel end time t 5 . The 
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amount of change in the moving-to-moving position angle is - 
31.33°. 

FIGS. 70A and 70B show an operational example that is 
interpreted as a counterclockwise rotation operation. As 
shown, a designated position point A is fixed while 
designated moving positions B and C respectively move from a 
point Bt 1 and a point Ct 1 to a point Bt 5 and a point Ct 5 . 
This input is interpreted as a counterclockwise rotation 
operation. 

FIGS. 71A-71E show the corresponding data samples that 
are interpreted as the counterclockwise rotation operation. 
In a graph 7101, the designated fixed position A has 
coordinates A(3,3). The designated moving position B is 
placed at coordinates Bt 1 {4,6) at the travel start time t 1 
and placed at coordinates Bt 5 (2,5) at the travel end time t s . 
The designated moving position C is placed at coordinates 
0^(2,1) at the travel start time t x and placed at 
coordinates Ct 5 (2.5,2) at the travel end time t 5 . Tables 

7102 list position data of the designated fixed position 
point A, the designated moving position point B, and the 
designated moving position point C from t 1 to t 5 . A table 

7103 lists data of angle change in the moving-to-moving 
position angle. In the angle change data, the moving-to- 
moving position angle is 68.20° at the travel start time t x 
and is 99.46° at the travel end time t 5 . The amount of 
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change in the moving- to-moving position angle is +31.26°. 

FIGS. 72A and 72B show an operational example that is 
interpreted as a rotation operation about the center of 
gravity of three designated moving positions. As shown, a 
designated position point A is fixed while designated moving 
positions B, C, and D respectively move from a point Bt lf a 
point ct lf and a point Dt 2 to a point Bt 5 , a point Ct 5/ and a 
point Dt 5 . This input is interpreted as the rotation 
operation about the center of gravity. 

FIGS. 73A-73H show the corresponding data samples that 
are interpreted as the rotation operation about the center 
of gravity. In a graph 7301, the designated fixed position 
A has coordinates A(3,3). The designated moving position B 
is placed at coordinates 6^(5,5) at the travel start time t 2 
and placed at coordinates Bt 5 (4,8) at the travel end time t 5 . 
The designated moving position C is placed at coordinates 
0^(4,3.5) at the travel start time t x and placed at 
coordinates Ct 5 (2,2) at the travel end time t 5 . The 
designated moving position D is placed at coordinates DM5.5, 
4.5) at the travel start time t x and placed at coordinates 
Dt 5 (6,9) at the travel end time t 5 . Tables 7 3 02 list 
position data of the designated fixed position point A, the 
designated moving position point B, the designated moving 
position point C, and the designated moving position point D 
from tj to t 5 . Table 7 3 03 list data of distance change 
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between the designated moving positions. In the distance 
change data, the distance change between the designated 
moving positions B and C is 1.803 at the travel start time t 2 
and is 6.325 at the travel end time t 5 . The magnification 
resulting from the distance change therebetween is 351%. 
The distance change between the designated moving positions 
B and D is 0.7 07 at the travel start time t a and is 2.236 at 
the travel end time t 5 . The magnification resulting from the 
distance change therebetween is 316%. The distance change 
between the designated moving positions C and D is 1.803 at 
the travel start time t x and is 8.062 at the travel end time 
t 5 . The magnification resulting from the distance change 
therebetween is 447%. 

Ninth embodiment 

A ninth embodiment of the present invention is now 
discussed. The ninth embodiment accounts for a positional 
relationship between a plurality of designated positions 
when an operation to perform is interpreted from a 
combination of travel paths of at least two designated 
positions . 

FIG. 74 is a flow diagram showing an algorithm that 
uses a positional relationship between designated positions. 
In step S7401, a process is performed to acquire the 
positional relationship between the designated positions. 
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In step S7402, a designation interpretation process is 
performed to interpret the input based on the acquired 
positional relationship between the plurality of designated 
positions . 

5 FIG. 75 is a flow diagram showing, in the step S7401, 

the process for determining the positional relationship 
between designated positions. In step S7501, the angle of 
the designated positions is acquired. When the acquired 
angle is found to be within a range of from 45° to 135° with 
10 respect to 90° or a range of from -45° to -135° with respect 
to -90° in step S7502, the positional relationship between 
the designated position points is vertically upward or 
downward. When the acquired angle is found to be within a 
range of from 45° to -45° with respect to 0° or a range of 
15 from 135° to -135° with respect to 180° in step S7502, the 
relationship between the designated position points is 
laterally rightward or leftward. The interpretation of 
angle is already illustrated in FIG. 35. 

FIG. 76 is a flow diagram showing, in the step S7402, 
2 0 the designation interpretation process based on the 

positional relationship between the designated position 
points. In step S7601, a process is performed to acquire an 
area of travel. In step S7 602, the positional relationship 
is interpreted. When the positional relationship is 
25 vertically upward or downward, the algorithm proceeds to 
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step S7603. The input is thus interpreted as a command for 
one of a cutting operation and a deleting operation. When 
the positional relationship is laterally rightward or 
leftward, the algorithm proceeds to step S7604. The input 

5 is thus interpreted as a command for a copying operation. 
FIG. 7 7 shows an operational example that is 
interpreted as a vertical-relationship translation operation. 
As shown, designated position points A and B respectively 
move from At x and Bt x to At 5 and Bt 5 . The input is thus 

10 interpreted as a vertical-relationship translation operation. 

FIGS. 7 8A-7 8D show the corresponding data samples that 
are interpreted as the vertical-relationship translation 
operation. In a graph 7801, the angle t x representing the 
relationship of the designated positions is 108.43° when the 

15 designated positions A and B respectively are placed at 

coordinates At 1 (4,5) and coordinates Bti(3,8) at travel start 
time t 1 . The angle t 5 representing the relationship of the 
designated positions is 108.43° when the designated position 
points A and B are respectively placed at coordinates 

2 0 A t 5(8,5) and at coordinates Bt 5 (7,8) at travel end time t 5 . 
Tables 7802 list position data of the designated position 
point A and the designated position point B from time t x to 
time t 5 . A table 7803 lists data of the positional 
relationship between the designated positions, namely, the 

25 angles of the lines connecting the designated positions with 
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respect to the horizontal line from time t x to time t s . 

FIGS. 79A and 79B show an operational example that is 
interpreted as a lateral relationship translation operation. 
As shown r designated position points A and B respectively 
move from Atj and Bt x to At 5 and Bt 5 . The input is thus 
interpreted as a lateral-relationship translation operation. 

FIGS. 80A-80D show the corresponding data samples that 
are interpreted as the lateral-relationship translation 
operation. In a graph 8001, the angle t x representing the 
relationship of the designated positions is 26.57° when the 
designated position points A and B respectively are placed 
at coordinates At^S^S) and coordinates Bt x (5,9) at travel 
start time t x . The angle t s representing the relationship of 
the designated positions is 26.57° when the designated 
position points A and B are respectively placed at 
coordinates At 5 (7,8) and at coordinates Bt 5 (9,9) at travel 
end time t 5 . Tables 8002 list position data of the 
designated position point A and the designated position 
point B from time t L to time t 5 . A table 8003 lists data of 
the positional relationship between the designated position 
points, namely, the angles of the lines connecting the 
designated positions with respect to the horizontal line 
from time t x to time t 5 . 



Tenth embodiment 
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A tenth embodiment of the present invention is now 
discussed. The tenth embodiment accounts for a change in a 
positional relationship between a plurality of designated 
positions when an operation to perform is interpreted from a 
combination of travel paths of at least two designated 
positions . 

FIG. 81 is a flow diagram showing a designation 
interpretation process based on a positional relationship 
between designated positions. In step S8101, a process is 
performed to determine a change in the positional 
relationship between the designated positions. In step 
S8102, a designation interpretation process is performed to 
interpret the input based on the data of the change in the 
positional relationship. 

FIG. 82 is a flow diagram showing a designation 
interpretation process based on the positional relationship 
between the designated positions. In step S8201, the amount 
of angle change is checked. When the amount of angle change 
is in a direction of inversion, the algorithm proceeds to 
step S8202. The input is then interpreted as a command for 
one of an inversion operation, a deleting operation, and a 
cutting operation. When the amount of angle change is not 
in a direction of inversion in the step S8201, the algorithm 
proceeds to step S8203. A positional change in the x 
direction is checked. When the designated positions are 
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laterally inverted, the algorithm proceeds to step S8204. 
The input is interpreted as a command for one of a laterally 
right-left inverting operation/ a deleting operation, and a 
cutting operation. 

When the positional change in the X direction is not 
laterally inverted in the step S8203, the positional change 
in the Y direction is checked in step S8205. When the 
designated positions are found to be vertically inverted in 
the step S8205, the algorithm proceeds to step S8206. The 
input is thus interpreted as a command for one of a 
vertically up and down inverting operation, a deleting 
operation, and a cutting operation. When the designated 
positions are not vertically inverted in the step S8205, the 
algorithm proceeds to step S8207. The input is interpreted 
as a command for one of an expansion operation, and a 
contraction operation. 

FIG. 83 is a flow diagram showing an algorithm for 
acquiring a change in the positional relationship between 
the designated positions. In step S8301, a process is 
performed to acquire the angle of the designated positions. 
In step S8302, a process is performed to acquire a change in 
the angle of the designated positions. When the angle 
change acquired in the step S83 02 falls within a 
predetermined range with respect to a bilaterally 
symmetrical direction in step S83 03, the algorithm proceeds 



to step S8304. The positional relationship change between 
the designated positions is interpreted as an inversion 
operation. 

When the acquired angle change is found to fall outside 
the predetermined range in step S8303, the algorithm 
proceeds to step S8305. In step S8305, a process is 
performed to determine a lateral positional relationship 
between the designated positions. In step S8306, a process 
is performed to determine a change in the lateral positional 
relationship between the designated positions. The 
algorithm proceeds to step S83 07. When the acquired change 
in the lateral positional relationship is found to be 
negative in the step S8307, the algorithm proceeds to step 
S8308, and the acquired change in the lateral positional 
relationship is interpreted as a laterally right and left 
inverting operation. 

When the acquired change in the lateral positional 
relationship is found to be positive in the step S8307, the 
algorithm proceeds to step S8309. In step S8309, a process 
is performed to determine a vertical positional relationship 
between the designated positions. In step S8310, a process 
is performed to determine a change in the vertical 
positional relationship between the designated positions. 
The algorithm proceeds to step S8311. When the acquired 
change in the vertical positional relationship is found to 
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be negative in the step S8311, the algorithm proceeds to 
step S8312. The acquired change in the vertical positional 
relationship is thus interpreted as a vertically up and down 
inverting operation. On the other hand, when the acquired 
change is found to be positive in the step S8311, the 
algorithm proceeds to step S8313, and the positional 
relationship is thus determined to be free from any change. 

FIGS. 84A and 84B show an operational example that is 
interpreted as an inversion operation. As shown, designated 
position points A and B respectively move from points At x and 
Bt x to points At 5 and Bt 5 . This input is interpreted as the 
inversion operation. 

FIGS. 85A-85D show the corresponding data samples that 
are interpreted as the inversion operation. In a graph 8501, 
the angle t x of the line connecting the designated position 
point A to the designated position point B with respect to 
the horizontal line is 14.04° when the designated position 
points A and B respectively are placed at coordinates 
At 1 (4,10) and coordinates 6^(8,11) at travel start time t x . 
The angle t 5 of the line connecting the designated position 
point A to the designated position point B is -165.96° when 
the designated position points A and B are respectively 
placed at coordinates At 5 (8,4) and at coordinates Bt 5 (4,3) at 
travel end time t 5 . Tables 8502 list position data of the 
designated position point A and the designated position 
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point B from time t a to time t 5 . A table 8503 lists data of 
the positional relationship between the designated positions. 
Specifically, the table 8503 stores the changes in the 
positional relationship between the designated positions in 
the X direction, and in the Y direction, and in the angle of 
the designated positions. In this case, the change in the 
positional relationship is 180°, indicating that the 
designated position point A and the designated position 
point B are inverted in position. 

FIGS. 86A and 86B show an operational example that is 
interpreted as a lateral inversion operation. As shown, the 
designated position points A and B respectively move from 
points At x and Btj to points At s and Bt 5 . This input is 
interpreted as a laterally right and left inverting 
operation. 

FIGS. 87A-87D show the corresponding data samples that 
are interpreted as the lateral inversion operation. In a 
graph 8701, the angle t 2 of the line connecting the 
designated position point A to the designated position point 
B with respect to the horizontal line is 71.57° when the 
designated position points A and B respectively are placed 
at coordinates At L ( 10,10) and coordinates 6^(11,13) at 
travel start time t x . The angle t 5 of the line connecting 
the designated position point A to the designated position 
point B is 116.57° when the designated position points A and 
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B are respectively placed at coordinates At 5 (9 / 3) and at 
coordinates Bt 5 (8,5) at travel end time t 5 . Tables 8702 list 
position data of the designated position point A and the 
designated position point B from time t x to time t 5 . A table 
5 8703 lists data of the positional relationship between the 
designated positions. Specifically, the table 8703 stores 
the changes in the positional relationship between the 
designated positions in the X direction, and in the Y 
direction, and in the angle of the designated positions. 

10 Since the positional relationship in the X direction changes 
from negative to positive in this case, the designated 
position points A and B are laterally inverted. 

FIGS. 88A and 88B show an operational example that is 
interpreted as a vertical inversion operation. As shown, 

15 the designated position points A and B respectively move 

from points At a and Bt x to points At 5 and Bt 5 . This input is 
interpreted as a vertically up and down inverting operation. 

FIGS . 89A-89D show the corresponding data samples that 
are interpreted as the vertical inversion operation. In a 

2 0 graph 8901, the angle t 1 of the line connecting the 

designated position point A to the designated position point 
B with respect to the horizontal line is 56.31° when the 
designated position points A and B respectively are placed 
at coordinates At 1 (5,12) and coordinates Bt 1 (7,15) at travel 

25 start time t t . The angle t s of the line connecting the 
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designated position point A to the designated position point 
B is -45.00° when the designated position points A and B are 
respectively placed at coordinates At 5 (5,2) and at 
coordinates Bt 5 (6,l) at travel end time t 5 . Tables 8902 list 
5 position data of the designated position point A and the 

designated position point B from time t r to time t 5 . A table 
8903 lists data of the positional relationship between the 
designated positions. Specifically, the table 8903 stores 
the changes in the positional relationship between the 
10 designated positions in the X direction, and in the Y 

direction, and in the angle of the designated positions. 
Since the positional relationship in the Y direction changes 
from negative to positive in this case, the designated 
position points A and B are vertically up and down inverted. 

15 

Eleventh embodiment 

An eleventh embodiment of the present invention is now 

discussed. The eleventh embodiment accounts for a 

positional relationship between a designated fixed position 
20 and a designated moving position when an operation to 

perform is interpreted from a combination of travel paths of 

at least two designated positions. 

FIG. 90 is a flow diagram showing an algorithm for 

determining a positional relationship between designated 
25 positions. In step S9001, a process is performed to detect 
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the designated fixed position. In step 9002, a process is 
performed to determine the positional relationship between 
the designated fixed position and the designated moving 
position. 

5 FIG. 91 is a flow diagram of a designation 

interpretation process based on the positional relationship 
to the designated fixed position. In step S9101, a process 
is performed to interpret the input based on the determined 
positional relationship data. 

10 FIG. 92 is a flow diagram showing in detail the 

designation interpretation process based on the positional 
relationship of the designated fixed position. In step 
S9201, a process is performed to acquire the direction of 
travel of the designated moving position. In step S9202, 

15 the travel direction is determined. When the travel 

direction is found to be leftward in the step S9202, the 
algorithm proceeds to step S9203. 

When the positional relationship of the designated 
moving position is found to be to the right of the 

20 designated fixed position in the step S9203, the algorithm 
proceeds to step S9207 . The input is interpreted as a 
command for one of a next-item operation, a next-page 
operation, a next-screen operation, a last-line operation, 
and a contraction operation in a lateral direction only. 

25 When the positional relationship of the designated moving 
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position is found to be the left of the designated fixed 
position in the step S9203, the algorithm proceeds to step 
S9208. The input is interpreted as a command for one of a 
leftward screen shifting operation and an expansion 
5 operation in a lateral direction only. When the positional 
relationship of the designated moving position is found to 
be above the designated fixed position in the step S9203, 
the algorithm proceeds to step S9209. The input is 
interpreted as a command for a counterclockwise rotation 

10 operation. When the positional relationship of the 
designated moving position is found to be below the 
designated fixed position in the step S9203, the algorithm 
proceeds to step S9210. The input is interpreted as a 
command for a clockwise rotation operation. 

15 When the travel direction is found to be upward in the 

step S9202, the algorithm proceeds to step S9204. When the 
positional relationship of the designated moving position is 
found to be to the right of the designated fixed position in 
the step S9204, the algorithm proceeds to step S9211. The 

20 input is interpreted as a command for a counterclockwise 

rotation operation. When the positional relationship of the 
designated moving position is found to be to the left of the 
designated fixed position in the step S9204, the algorithm 
proceeds to step S9212. The input is interpreted as a 

25 command for a clockwise rotation operation. When the 
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positional relationship of the designated moving position is 
found to be above the designated fixed position in the step 

59204, the algorithm proceeds to step S9213. The input is 
interpreted as a command for a screen upward shifting 

5 operation or an expansion operation in a vertical direction. 
When the positional relationship of the designated moving 
position is found to be below the designated fixed position 
in the step S9204, the algorithm proceeds to step S9214. 
The input is interpreted as a command for one of a next-item 

10 operation, a next-page operation, a next-screen operation, a 
last-line operation, and a contraction operation in a 
lateral direction only. 

When the travel direction is found to be downward in 
the step 9202, the algorithm proceeds to step S9205. When 

15 the positional relationship of the designated moving 

position is found to be to the right of the designated fixed 
position in the step S9205, the algorithm proceeds to step 
S9215. The input is interpreted as a command for a 
clockwise rotation operation. When the positional 

2 0 relationship of the designated moving position is found to 
be to the left of the designated fixed position in the step 

59205, the algorithm proceeds to step S9216. The input is 
interpreted as a command for a counterclockwise rotation 
operation. When the positional relationship of the 

25 designated moving position is found to be above the 
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designated fixed position in the step S9205, the algorithm 
proceeds to step S9217. The input is interpreted as a 
command for one of a preceding- item operation, a preceding- 
page operation, a preceding-screen operation, a first-line 
5 operation, and a contraction operation in a vertical 

direction only. When the positional relationship of the 
designated moving position is found to be below the 
designated fixed position in the step S9205, the algorithm 
proceeds to step S9218. The input is interpreted as a 

10 command for a downward screen shifting operation. 

When the travel direction is found to be rightward in 
the step S9202, the algorithm proceeds to step S9206. When 
the positional relationship of the designated moving 
position is found to be to the right of the designated fixed 

15 position in the step S9206, the algorithm proceeds to step 
S9219. The input is interpreted as a command for one of 
rightward screen shifting operation and an expansion 
operation in a lateral direction only. When the positional 
relationship of the designated moving position is found to 

20 be to the left of the designated fixed position in the step 
S9206, the algorithm proceeds to step S9220. The input is 
interpreted as a command for one of a preceding- item 
operation, a preceding-page operation, a preceding-screen 
operation, a first-line operation, and a contraction 

25 operation in a vertical direction only. When the positional 
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relationship of the designated moving position is found to 
be above the designated fixed position in the step S9206, 
the algorithm proceeds to step S9221. The input is 
interpreted as a command for a clockwise rotation operation. 
5 When the positional relationship of the designated moving 
position is found to be below the designated fixed position 
in the step S9206, the algorithm proceeds to step S9222. 
The input is interpreted as a command for a counterclockwise 
rotation operation. 

10 FIG. 93 is a flow diagram showing an algorithm for 

determining the positional relationship to the designated 
fixed position. In step S9301, a process is performed to 
acquire an angle of the designated positions. When the 
acquired angle is found to fall within a predetermined range 

15 in an upward direction in step S9302, the positional 

relationship of the designated positions is determined to be 
upward in step S9303. When the acquired angle is found to 
fall within a predetermined range in a downward direction in 
the step S9302, the positional relationship is determined to 

20 downward in step S9304. When the acquired angle is found to 
fall within a predetermined range in a leftward direction in 
the step S9302, the positional relationship is determined to 
be leftward in step S93 05. When the acquired angle is found 
to fall within a predetermined range in a rightward 

25 direction in the step S9302, the positional relationship is 
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determined to be leftward in step S9306. 

FIG. 94 is a flow diagram showing an algorithm for 
acquiring the direction of travel of a designated position. 
As shown, in step S9401, a process is performed to acquire 
5 the angle of travel of a designated position. When the 

acquired angle is found to fall within a predetermined range 
in an upward direction in step S9402, the travel direction 
relationship of the designated positions is determined to be 
upward in step S9403. When the acquired angle is found to 

10 fall within a predetermined range in a downward direction in 
the step S9402, the travel direction is determined to 
downward in step S9404. When the acquired angle is found to 
fall within a predetermined range in a leftward direction in 
the step S9402, the travel direction is determined to be 

15 leftward in step S9405. When the acquired angle is found to 
fall within a predetermined range in a rightward direction 
in the step S9402, the travel direction is determined to be 
rightward in step S9406. 

FIGS. 95A and 95B show two operational examples that 

2 0 are interpreted as a next-item operation or a leftward 
screen shifting operation depending on the positional 
relationship of designated positions even though the travel 
directions thereof are the same. As shown in FIG 95A, a 
designated position point B, placed to the right of a 

25 designated fixed position point A, leftward moves. An 
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operation to perform is interpreted as one of a next-item 
operation, a next-screen operation, a last-line operation, 
and a contraction operation in a lateral direction only. On 
the other hand, as shown in FIG. 95B, a designated moving 
5 position point D, placed to the left of a designated fixed 
position point C, leftward moves. An operation to perform 
is interpreted as one of a leftward screen shifting 
operation and an expansion operation in a lateral direction 



the designated fixed position point, leftward moves, an 
operation to perform is interpreted as a counterclockwise 
rotation operation. When the designated moving position 
point, placed below the designated fixed position point, 

15 leftward moves, an operation to perform is interpreted as a 
clockwise rotation operation. 

When the travel direction is upward, the following 
interpretations are preformed depending on the positional 
relationship. With the designated moving position point 

2 0 placed to the right of the designated fixed position point, 
an operation to perform is interpreted as a counterclockwise 
rotation operation. With the designated moving position 
point placed to the left of the designated fixed position 
point, an operation to perform is interpreted as a clockwise 

25 rotation operation. With the designated moving position 



only. 



10 



When the designated moving position point, placed above 
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placed above the designated fixed position point, an 
operation to perform is interpreted as one of an upward 
screen shifting operation , and an expansion operation in a 
vertical direction only- With the designated moving 
5 position point placed below the designated fixed position 

point/ an operation to perform is interpreted as a next-item 
operation, a next-page operation, a next-screen operation, a 
last-line operation, and a contraction operation in a 
vertical direction only. 

10 When the travel direction is downward, the following 

interpretations are preformed depending on the positional 
relationship. With the designated moving position point 
placed to the right of the designated fixed position point, 
an operation to perform is interpreted as a clockwise 

15 rotation operation. With the designated moving position 
point placed to the left of the designated fixed position 
point, an operation to perform is interpreted as a 
counterclockwise rotation operation. With the designated 
moving position placed above the designated fixed position 

20 point, an operation to perform is interpreted as one of a 
preceding-item operation, a preceding-page operation, a 
preceding-screen operation, a first-line operation, and a 
contraction operation in a vertical direction only. With 
the designated moving position point placed below the 

25 designated fixed position point, an operation to perform is 
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interpreted as one of a downward screen shifting operation 
and an expansion operation in a vertical direction only. 

When the travel direction is rightward, the following 
interpretations are preformed depending on the positional 
5 relationship. With the designated moving position point 

placed to the right of the designated fixed position point, 
an operation to perform is interpreted as one of a rightward 
screen shifting operation and an expansion operation in a 
lateral direction only. With the designated moving position 

10 point placed to the left of the designated fixed position 
point, an operation to perform is interpreted as a 
preceding- item operation, a preceding-page operation, a 
preceding-screen operation, a first-line operation, and a 
contraction operation in a vertical direction only. With 

15 the designated moving position placed above the designated 

fixed portion point, an operation to perform is interpreted 
as a clockwise rotation operation. With the designated 
moving position point placed below the designated fixed 
position point, an operation to perform is interpreted as a 

2 0 counterclockwise rotation operation. 

FIGS. 96A-96D show the corresponding data samples that 
are interpreted as a next-item operation. In a graph 9601, 
a designated fixed position point A remains stationary at 
A(3,3), a designated moving position point B is placed at 

25 Bt!(6,2.8) at travel start time t x and at Bt 5 (4,2) at travel 
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end time t 5 . Tables 9602 list position data of the 
designated fixed position point A and the designated moving 
position point B from time t x to time t 5 . A table 9603 lists 
the positional relationship between the designated fixed 
5 position and the designated moving position. As listed, at 
the travel end time t 5/ the designated fixed position point A 
has a distance of travel of zero, and the designated moving 
position point B has a distance of travel of 2.236. The 
positional relationship between the designated fixed 
10 position A and the designated moving position B is changed 
from 176.19° at the travel start time t L to 135.00° at the 
travel end time t s . The direction of travel of the 
designated moving position point B is -153.43°. 

15 Twelfth embodiment 

A twelfth embodiment of the present invention is now 
discussed. The twelfth embodiment accounts for a change in 
the positional relationship between two designated fixed 
positions and a single designated moving position when an 

2 0 operation to perform is interpreted from a combination of 
travel paths of at least two designated positions. 

FIG. 97 is a flow diagram showing an algorithm for 
determining a positional relationship between designated 
fixed positions and a designated moving position. As shown, 

25 in step S9701, a process is performed to determine the 
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positional relationship between the two designated fixed 
positions and the designated moving position. In step S9702, 
a designation interpretation process is performed to 
interpret the input based on the acquired positional 
5 relationship. 

FIG. 98 is a flow diagram showing an algorithm for 
determining the positional relationship between designated 
positions. In step S9801, the angle of a line connecting 
the two designated fixed positions (fixed-to-fixed-position 

10 angle) is acquired. In step S9802, a process is performed 
to acquire the angle of a line connecting one of the two 
designated fixed positions to the designated moving position 
(fixed-to-moving-position angle). In step S9803, a process 
is performed to acquire the relationship between the angle 

15 of the line connecting the two designated fixed position and 
the angle of the line connecting the one of the two 
designated fixed position and the designated moving position. 
In step S9804, a process is performed to acquire a change in 
the relationship between the two angles. 

2 0 FIG. 99 is a flow diagram showing an algorithm for 

determining the positional relationship between the 
designated positions. When the fixed-to-fixed-position 
angle is smaller than the fixed-to-moving-position angle in 
step S9901, the algorithm proceeds to step S9902, and the 

25 positional relationship is determined to be in a clockwise 
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rotation direction. When the fixed-to- fixed-position angle 
equals the fixed-to-moving position angle in step S9901, the 
algorithm proceeds to step S9903, and the positional 
relationship is determined to be coincident. When the 
fixed-to-fixed-position angle is greater than the fixed-to- 
moving position angle in step S9901, the algorithm proceeds 
to step S9904, and the positional relationship is determined 
to be in a counterclockwise rotation direction. 

FIG. 100 is a flow diagram showing an algorithm for 
acquiring a change in the positional relationship between 
the designated positions. When the latest position of a 
designated position fails to coincide with the initial 
position thereof in step S10001, the algorithm proceeds to 
step S10002. When the initial positional relationships of 
the designated positions fail to be coincident in step 
S10002, the algorithm proceeds to step S10003. When the 
latest positional relationships of the designated positions 
fail to be coincident in step S10003, the algorithm proceeds 
to step S10004. The positional relationship is thus 
determined to be an inversion. 

FIG. 101 is a flow diagram showing the designation 
interpretation process based on the positional relationship 
between the designated fixed positions and the designated 
moving position. When the determined change in the 
positional relationship is found to be an inversion in step 
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S10101, the algorithm proceeds to step S10102. The input is 
thus interpreted as an inversion operation with respect to a 
line connecting the designated fixed positions. 

FIGS. 102A and 102B show an operational example that is 
interpreted as a symmetrical inversion operation. There are 
shown two designated fixed position points A and B, and a 
designated moving position point C. The designated moving 
position point C moves from Ct x to Ct 5 . This input is 
interpreted as a symmetrical inversion operation. 

FIGS. 103A-103E show the corresponding data samples 
that are interpreted as the symmetrical inversion operation. 
In a graph 10301, there are shown the designated fixed 
positions A(3,l) and B(4,6). The fixed-to-fixed-position 
angle therebetween is 78.69° with respect to the X direction. 
The designated moving position point C is placed at 0^(5,3) 
at travel start time t lf and the fixed-to-moving-position 
angle t l to the designated fixed position point A is 45.00°. 
The point 0^(5,3) is placed to the right of the line AB 
connecting the two designated fixed position points A and B. 
The designated moving position point B is placed at Ct 5 (3,3) 
at travel end time t 5 . The fixed-to-moving-position angle t 5 
to the designated fixed position point A is 90.00° with 
respect to the X direction. The point Ct 5 is placed to the 
left of the line AB connecting the two designated fixed 
positions . 




Tables 10302 list position data of the designated fixed 
position points A and B and the designated moving position 
point c from time t x to time t 5 . A table 10303 lists the 
positional relationship between the two designated fixed 
5 positions and the designated moving position. As listed, 
the fixed-to-fixed-position angle remains unchanged from 
78. 69°, and the fixed-to-moving-position angle t x increases 
from 45.00° at t x to 90.00° at t 5 , thereby becoming greater 
than the fixed-to-fixed-position angle. 

10 

Thirteenth embodiment 

A thirteenth embodiment of the present invention is now 
discussed. The thirteenth embodiment accounts for a change 
in the positional relationship between three designated 

15 fixed positions and a single designated moving position when 
an operation to perform is interpreted from a combination of 
travel paths of at least two designated positions. 

FIG. 104 is a flow diagram showing an algorithm for at 
least three designated fixed positions. When there are at 

20 least three designated fixed positions in step S10401, the 
algorithm proceeds to step S10402. A process is performed 
to determine a positional relationship between at least 
three designated fixed positions and a designated moving 
position, in step S10403, a designation interpretation 

25 process is performed to interpret the input based on the 
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positional relationship. 

FIG. 105 is a flow diagram of a process for determining 
the positional relationship of the designated moving 
position with respect to the plurality of designated fixed 
5 positions. In step S10501, a process is performed to 

acquire fixed-to-fixed-position angles. In step Si 05 02, a 
process is performed to acquire the angle of a line 
connecting the designated moving position and one of the 
plurality of designated fixed positions ( fixed- to-moving- 

10 position angle). In step S10503, a process is performed to 
determine a relationship between the fixed-to-fixed-position 
angle and the fixed-to-moving-position angle, in step 
S10504, a process is performed to acquire a change in the 
relationship of the angles. 

15 FIG. 106 is a flow diagram of a process for acquiring 

the positional relationship between at least three 
designated fixed positions and a single designated moving 
position. In step S10601, designated fixed positions are 
retrieved from a list of designated fixed positions from a 

20 designated fixed position table. A first designated fixed 
position is retrieved from the designated fixed position 
list in step S10602. When the designated fixed position to 
be retrieved is higher in listing order than the last 
designated fixed position in the list in step S10603, the 

25 algorithm proceeds to step S10604 to retrieve the designated 
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fixed position. In step S10605, the fixed- to-moving- 
position angle is found to be not more than the maximum 
fixed-to-fixed-position angle, the algorithm proceeds to 
step S10606. When the fixed-to-moving-position angle is 
5 found to be not less than the minimum fixed-to- fixed- 
position angle in the step Si 06 06, the algorithm proceeds to 
step S10607 to advance in the list. 

When the designated fixed position reaches the last one 
in the list in the step S10603, the algorithm proceeds to 

10 step S10608. The designated moving position is interpreted 
as being present within an area defined by the designated 
fixed positions. When the fixed- to-moving-position angle is 
found to be more than the maximum fixed-to-fixed-position 
angle in the step S10605, the algorithm proceeds to step 

15 S10609. When the fixed-to-moving-position angle is found to 
be less than the minimum fixed-to-fixed-position angle in 
step SI 0606, the algorithm proceeds to step SI 060 9. The 
designated moving position is interpreted as being present 
outside the area of the designated fixed positions. 

20 FIG. 107 shows an operational example that is 

interpreted to mean that the designated moving position is 
within an area defined by the designated fixed positions. 
As shown, the positional relationship of a designated moving 
position Dti is interpreted as being within the area that is 

25 enclosed by designated fixed positions A, B, and C. 
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FIGS. 108A-108F show the corresponding data samples 
which are interpreted to mean that the designated moving 
position is within the area defined by the designated fixed 
positions. In a graph 10801, there are shown the designated 
fixed position A(3,l), the designated fixed position B(4,6), 
the designated fixed position C( 6,5.5), and the designated 
moving position Dt 1 (4,4). The angle DAO of the line 
connecting the designated fixed position to the point Dt x , 
being 71.57°, is between the angle BAO at the designated 
fixed position A being 78.69° and the angle CAO at the 
designated fixed position A being 56.31°. The angle O'BD of 
the line connecting the point Dt x to the designated fixed 
position B, being -90. 00°, is between the angle O'BA at the 
designated fixed position B being -101.31° and the angle 
O'BC ad the designated fixed position B being -14.04°. 

Tables 10802 list position data of the designated fixed 
positions A, B, and c, and the designated moving position D. 
A table 10803 list changes in the positional relationship 
between the designated fixed positions and the designated 
moving position. As listed, the angle DAO from the 
designated fixed position to the designated moving position 
D (fixed-to-moving-position angle), being 71.57°, is between 
the (fixed-to-fixed-position) angle BAO being 78.69° and the 
(fixed-to-fixed-position) angle CAO being 56.31°. The angle 
O'BD from the designated moving position D to the designated 



fixed position B (fixed-to-moving-position angle) being - 
9 0.00% is between the (fixed-to-moving) angle O'BA being - 
101.31° and the (fixed-to-fixed) angle O'BC being -14.04°. 

FIG. 109 is a flow diagram showing an algorithm for 
acquiring the positional relationship between the designated 
positions. When the change in the positional relationship 
is determined to be an outward shifting out from within the 
area in step S10901, the algorithm proceeds to step S10902. 
The input is thus interpreted as an outward shifting 
operation from within the area. When the change in the 
positional relationship is determined not to be an outward 
shifting operation out from within the area in step S10901, 
the algorithm proceeds to step S10903. When the change in 
the positional relationship is determined to be an inward 
shift operation into the area in the step S10903, the 
algorithm proceeds to step S10904. The input is thus 
interpreted as an inward shifting operation into the area. 

FIG. 11 OA and 11 0B show an operational example which is 
interpreted as an outward shifting operation from within the 
area of the designated fixed positions. As shown, the 
moving position Dt x outwardly moves to Dt 5 out of the area 
enclosed by the designated fixed positions A, B, and C. in 
the positional relationship of the designated moving 
position to the plurality of designated fixed positions, the 
input is thus interpreted as an outward shifting operation 
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out of the area of the designated fixed positions. 

FIGS. 111A-111F show the corresponding data samples 
which are interpreted to mean the outward shifting operation 
from within the area in a positional relationship change 
5 determination process. In a graph 11101, there are shown a 
designated fixed position point A(3,l), a designated fixed 
position point 6(4,6), a designated fixed position point 
C(6,5.5), and a designated moving position point Dt 1 (4,4) at 
travel start time t^ The angle DAO of the line connecting 

10 the point Dt x to the designated fixed position point A, being 
71.57°, is between the angle BAO at the designated fixed 
position point A being 78.69° and the angle CAO at the 
designated position point A being 5 6.31°. The angle O'BD of 
the line connecting the point Dt x to the designated fixed 

15 position point B being -90.00° is between the angle O'BA at 
the designated fixed position B being -101.31° and the angle 
O'BC ad the designated fixed position B being -14.04°. At 
the travel end time t s , the designated moving position point 
moves to Dt 5 (3,4). The angle DAO of the line connecting the 

2 0 point Dt 5 to the designated fixed position point A, being 

90.00°, falls outside the range between the angle BAO at the 
designated fixed position point A being 7 8.69° and the angle 
CAO at the designated position point A being 56.31°. The 
angle O'BD of the line connecting the point Dt 5 to the 

25 designated fixed position point B being -116.57 falls 
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outside the range between the angle O'BA at the designated 
fixed position B being -101.31° and the angle O'BC ad the 
designated fixed position B being -14.04°. 

Tables 11102 list position data of the designated fixed 
5 position points A, B, and C, and the designated moving 
position point D from time t L to time t 5 . A table 11103 
lists the change in the positional relationship between the 
designated fixed positions and the designated moving 
position. As listed, both the angle DAO of the line 

10 connecting the point D to the designated fixed position 

point A, and the angle O'BD of the line connecting the point 
D to the designated fixed position point B fall within the 
respective ranges determined by the area of the designated 
fixed positions from time t x to time t 3 , and depart from the 

15 respective ranges at time t 4 . 

FIG. 112 is a flow diagram showing a designation 
interpretation process based on the positional relationship 
of a designated moving position to a plurality of designated 
fixed positions. When the positional relationship is 

20 determined to be an outward shifting operation from within 
the area in step Si 1201, the algorithm proceeds to step 
SI 12 02. The input is then interpreted as a deleting 
operation for deleting the area of the designated fixed 
positions. When the positional relationship is determined 

25 not to be an outward shifting operation from within the area 
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in step S11201, the algorithm proceeds to step S11203. When 
the positional relationship is determined to be an inward 
shifting operation into the area in step SI 1203, the 
algorithm proceeds to step S11204. The input is interpreted 
5 as an operation for imparting an attribute to the area of 
the designated fixed positions. The attribute imparting 
operation may include the coloring of the area of the 
designated fixed positions. 

FIGS. 113A and 113B show an operational example that is 

10 interpreted to mean that an attribute is imparted to the 
area defined by the designated fixed positions. When a 
designated moving position point D is shifted from Dt x to Dt 5 
into the area enclosed by designated fixed positions A, B, 
and C, an operation to perform is interpreted as a coloring 

15 operation for coloring the area of the designated fixed 
positions . 

FIGS. 114A-114F show the corresponding data samples 
that are interpreted as a coloring operation, from among 
attribute imparting operations, to the area defined by the 

20 designated fixed positions, in a designated fixed-position 
based designation interpretation process. In a graph 11401, 
there are shown a designated fixed position point A(3,l), a 
designated fixed position point B{4,6), a designated fixed 
position point C(6,5.5), and a designated moving position 

25 point Dt 1 (3,4) at travel start time t x . The angle DAO of the 
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line connecting the point Dt L to the designated fixed 
position point A, being 90.00% falls outside the range 
between the angle BAO at the designated fixed position point 
A being 78.69° and the angle CAO at the designated position 
5 point A being 56.31°. The angle O'BD of the line connecting 
the point Dt. x to the designated fixed position point B being 
-116.57 falls outside the range between the angle O'BA at 
the designated fixed position B being -101.31° and the angle 
O'BC ad the designated fixed position B being -14.04°. At 

10 the travel end time t 5 , the angle DAO of the line connecting 
the point Dt 5 to the designated fixed position point A, being 
71.57°, is between the angle BAO at the designated fixed 
position point A being 7 8.69° and the angle CAO at the 
designated position point A being 59.04°. The angle O'BD of 

15 the line connecting the point Dt s to the designated fixed 
position point B being -90.00° is between the angle O'BA at 
the designated fixed position B being -101.31° and the angle 
O'BC ad the designated fixed position B being -14.04°. 

Tables 11432 list position data of the designated fixed 

20 position points A, B, and C, and the designated moving 
position point D from time t L to time t 5 . A table 11433 
lists the change in the positional relationship between the 
designated fixed positions and the designated moving 
position. As listed, both the angle DAO of the line 

25 connecting the point D to the designated fixed position 
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point A, and the angle O'BD of the line connecting the point 
D to the designated fixed position point B remains outside 
the respective ranges determined by the area of the 
designated fixed positions from time t 2 to time t 3 , and enter 
5 the respective ranges at time t 4 . 

Fourteenth embodiment 

A fourteenth embodiment of the present invention is now 
discussed. The fourteenth embodiment accounts for a change 

10 in a number of a plurality of designated positions when an 
operation to perform is interpreted from a combination of 
travel paths of at least two designated positions. 

FIG. 115 is a flow diagram showing a designation 
interpretation process based on a change in the count of a 

15 plurality of designated positions. In step S11501, a 

process is performed to acquire a designated position count. 
In step S11502, a process is performed to acquire a change 
in the designated position count. In step S11503, a 
designation interpretation process is performed to interpret 

20 the input based on the acquired designated position count. 

FIG. 116 is a flow diagram showing the designation 
interpretation process based on the change in the initial 
count of designated positions. In step S11601, a current 
designated position count is compared with an initial 

25 designated position count. When it is determined in step 



SI 1602 that the current designated position count is greater 
than the initial designated position count, the algorithm 
proceeds to step S11603. The input is interpreted as being 
in the middle of designating an object. 

FIGS. 117A and 117B show an operational example that is 
interpreted to mean that the designation of an object to be 
processed is on its way through the designation 
interpretation process using the change in the designated 
position count. There are shown two designated position 
points Atl and Bt x at time t x in FIG. 117A. There are shown 
three designated position points of At 2 , Bt 2 , and Ct 2 at time 
t 2 in FIG. 117B. The designated position count increases 
from two at time t x to three at time t 2 . 

FIGS. 118A-118F show the corresponding data samples 
that are interpreted to mean that the designation of the 
object to be processed is on its way. In graphs 11801, FIG. 
118A shows the two designated positions of At x and Bt 1 
occurring at time t x and FIG. 118B shows the three designated 
positions of At 2/ Bt 2 , and Ct 2 occurring at time t 2 . Tables 
11802 list position data of the designated position point A, 
the designated position point B, and the designated position 
point C from time t x to time t 3 . A table 11803 lists the 
change in the designated position count. As listed, the 
designated position count is two at time t lf resulting in a 
count change of zero. At time t 2 , the designated position 



count is three, resulting a count change of one. 

FIG. 119 is a flow diagram showing the designation 
interpretation process based on the change in the designated 
position count. In step S11901, a process is performed to 
5 acquire initial designated positions. When it is determined 
in step S11902 that the count of the acquired positions 
indicates any increase from the initial count of designated 
positions, the algorithm proceeds to step SI 1903. A 
designation interpretation process is performed to interpret 

10 the input based on the initial designated positions. 

FIG. 120 is a flow diagram showing the designation 
interpretation process based the an initial designated 
position. When the designated position count is one, the 
algorithm proceeds to step S12002. An operation to perform 

15 is thus interpreted as a rotation operation about the 
acquired designated position. 

FIGS. 121A and 121B show an operational example that is 
interpreted as the rotation operation about the designated 
position. An initial designated position point A is present 

20 at time t x . At time t 5 , there are shown the designated 

position point A and a designated position point Bt 5/ which 
has shifted from point Bt 3 . This input is interpreted as a 
rotation operation about the designated position point A. 
FIGS. 122A-122D show the corresponding data samples 

25 which is interpreted as the rotation operation about the 
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designated position. In a graph 12201, the designated 
position point A continuously stays at the same coordinates 
(3,3) from time t x to time t 6 . The designated position point 
B takes coordinates Bt 3 (6 / 2.8) at time t 3 , coordinates 
5 Bt 4 (5.6,3.5) at time t 4 , coordinates Bt 5 (5.2,4.2) at time t 5 , 
and coordinates Bt 6 (5,5) at time t 6 . Tables 12202 list 
position data of the designated position points A and B from 
time t 1 to time t 5 . A table 12203 lists the change in the 
designated position count. As listed, the designated 
10 position count remains one from time t x to time t 2 , resulting 
in a count change of zero. The designated position count 
increases to two at time t 3 , resulting in a count change of 
one. The count continuously remains unchanged to time t 6 . 

15 Fifteenth embodiment 

A fifteenth embodiment of the present invention is now 
discussed. The fifteenth embodiment accounts for a change 
in a number of a plurality of final designated positions 
when an operation to perform is interpreted from a 

20 combination of travel paths of at least two designated 
positions . 

FIG. 123 is a flow diagram showing an algorithm that 
uses a change in the last count of designated positions. In 
step S12301, a process is performed to acquire a change in 
25 the final designated position count. In step 12302, a 
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designation interpretation process is performed based on the 
change in the last designated position count. 

FIG. 124 is a flow diagram showing the designation 
interpretation process based on the change in the last count 
5 of the designated positions. When the designated position 
count indicates a decrease in step S12401, the algorithm 
proceeds to step S12402. The input is interpreted as a 
canceling operation to cancel the immediately preceding 
operation. When the designated position count indicates no 

10 decrease in step S12401, the algorithm proceeds to step 
S12403. The input is interpreted as a confirmation 
operation to confirm the immediately preceding operation. 

FIGS. 125A and 125B show an operational example that is 
interpreted as a canceling operation to cancel an 

15 immediately preceding operation in the designation 

interpretation process. As shown, there are three initial 
points At lf Bt x , and Ct x at time t x . At time t 2 , there are two 
designated position points At 2 and Bt 2 . The designated 
position count is decreased by one from time t^ 

20 FIGS. 126A-126F show the corresponding data samples 

that are interpreted as the canceling operation to cancel 
the immediately preceding operation. In a graph 12601, 
there are the three initial designated position points At lf 
Bt ir and Ct x at time t 1 . At time t 2 , there are the two 

25 designated position points At 2 and Bt 2 . Tables 12602 list 



# 
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position data of the designated position points A, B, and C 
from time t x to time t 2 . A table 12603 lists the change in 
the designated position count. As listed, the designated 
position count is three at time t L/ thereby resulting in a 
5 count change of zero. The designated position count is two 
at time t 2 , thereby resulting in a count change of -1. 

Sixteenth embodiment 

A sixteenth embodiment of the present invention is now 

10 discussed. The sixteenth embodiment accounts for a 

designated position count as designated information other 
than the designated path when an operation to perform is 
interpreted from a combination of travel paths of at least 
two designated positions. 

15 FIG. 127 is a flow diagram showing an algorithm that 

uses designated information other than a designated path. 
In step S12701, a process is performed to acquire designated 
information other than the designated path. The algorithm 
proceeds to step S12702. When it is determined in step 

20 S12702 that an operation is not repeated, the algorithm 
proceeds to step S12703. A designation interpretation 
process is performed to interpret the input based on the 
acquired designated information. When it is determined in 
the step S12 7 02 that the operation is repeated, the 

25 algorithm proceeds to step S12704. The input is interpreted 
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as a suspending operation to suspend the operation, and the 
process then proceeds to step S12703. 

FIG. 12 8 is a flow diagram showing an algorithm that 
uses designated information other than a designated path. 
5 When the designated information is equal to or greater than 
the maximum criterion value, the algorithm proceeds to step 
S12802. The input is interpreted as a maximum operational 
amount. When the designated information is smaller than the 
maximum criterion value, the algorithm proceeds to step 

10 S12803. When the designated information is equal to or 
greater than a repetition criterion value, the algorithm 
proceeds to step S12804 to increase an operational amount. 
The algorithm proceeds to step S12 805. The input is thus 
interpreted as an operation to narrow repetition intervals. 

15 When it is determined in the step S12 803 that the designated 

information is smaller than the repetition criterion value, 
the algorithm proceeds to step S12806. The input is thus 
interpreted as an operation to increase the operational 
amount . 

20 FIG. 129 is a flow diagram showing an algorithm that 

uses the count of all designated positions. In step S12901, 
a process is performed to acquire the count of all 
designated positions as the designated information other 
than the designated path. 

25 FIG. 130 is a flow diagram showing a designation 
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interpretation process based on the designated position 
count as the designated information other than the 
designated path. When the designated position count is 
equal to or greater than the maximum criterion value, the 
5 algorithm proceeds to step S13002. The input is interpreted 
as one of the maximum number of screens, the maximum number 
of items, and the maximum magnification. When the 
designated position count is smaller than the maximum 
criterion count, the algorithm proceeds to step S13003. 

10 When the designated position count is equal to or greater 
than a repetition criterion value in the step S13003, the 
algorithm proceeds to step S13004. The input is interpreted 
as an operation to increase one of the number of pages, the 
number of screens, the number of items, and magnification. 

15 The algorithm proceeds to step S13 005. The input is then 

interpreted as an operation to narrow repetition intervals. 
When it is determined in the step SI 3 003 that the designated 
position number is smaller than the repetition criterion 
value, the algorithm proceeds to step S13 006. The input is 

20 interpreted as an operation to increase one of the number of 
pages, the number of screens, the number of items, and 
magnification. The algorithm proceeds to step S13007 to 
interpret the input as one of a page-turning operation, a 
screen shifting operation, an item advancing operation, and 

25 an expansion/contraction operation. 



FIGS. 131A and 131B show an operational example that is 
interpreted as the page-turning operation. FIG. 13 1A shows 
two designated position points At x and Bt x appearing at time 
t x . FIG. 131B shows a total of four designated position 
points At 2 , Bt 2 , Ct 2 , and Dt 2 appearing at time t 2 . Since the 
designated position count is increased to four at time t 2 
from two at time t ir the input is interpreted as an operation 
for increasing the number of pages in page turning. 

FIGS. 132A-132H show the corresponding data samples 
that are interpreted as the page-turning operation. Graphs 

13201 show two designated position points A^ and Bt ± 
appearing at time tj and a total of four designated position 
points At 2 , Bt 2 , Ct 2 , and Dt 2 appearing at time t 2 . Tables 

13202 list position data of the designated positions A, B, c, 
and D from t : to t 2 . A table 13203 lists the change in the 
designated position count. As listed, the increase in the 
designated position count is two at time t^ resulting a 
total number of designated positions of three. At time t 2/ 
the increase in the designated position count is two, 
resulting in a total number of five. 

Seventeenth embodiment 

A seventeenth embodiment of the present invention is 
now discussed. The seventeenth embodiment accounts for the 
speed of travel of a designated position as the designated 
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information other than the designated path when an operation 
to perform is interpreted from a combination of travel paths 
of at least two designated positions. 

FIG. 133 is a flow diagram showing an algorithm for 
5 acquiring the speed of travel of the designated position as 
the designated position information other than the 
designated path. In step S13301, a process is performed to 
acquire the speed of travel of the designated position. In 
step S133 02, a designation interpretation process is 

10 performed to interpret the input based on the travel speed 
of the designated position. 

FIG. 134 is a flow diagram showing an algorithm for 
acquiring the speed of travel of the designated position. 
In step S134 01, the distance of travel of the designated 

15 position from the immediately preceding point thereof is 

acquired. In step S13402, the speed of travel is calculated 
from the acquired travel distance and time needed for the 
travel . 

FIG. 135 is a flow diagram showing the designation 
2 0 interpretation process based on the designated position 
travel speed as the designated information other than the 
designated path. When it is determined in step S13 501 that 
the travel speed of the designated position is equal to or 
greater than the maximum criterion value, the algorithm 
25 proceeds to step S13502. The input is interpreted as one of 
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the maximum number of pages , the maximum number of screens , 
the maximum number of items, and the maximum magnification. 
When it is determined in step S13501 that the travel speed 
of the designated position is smaller than the maximum 
5 criterion value, the algorithm proceeds to step S13503. 
When it is determined in step S13503 that the designated 
position travel speed is equal to or greater than the 
repetition criterion value, the algorithm proceeds to step 
S13504. The input is interpreted as an operation to 

10 increase one of the number of pages, the number of screens, 
the number of items, and magnification. The algorithm 
proceeds to step S13505 to interpret the input as an 
operation to narrow repetition intervals. When it is 
determined in the step S13503 that the designated position 

15 travel speed is smaller than the repetition criterion value, 
the algorithm proceeds to step S13506. The input is 
interpreted as an operation to increase one of the number of 
pages, the number of screens, the number of items, and 
magnification. The algorithm then proceeds to step S13507 

20 to interpret the input as one of a page-turning operation, a 
screen shifting operation, an item advancing operation, and 
an expansion/contraction operation. 

FIGS. 136A-136D show an operational example that is 
interpreted as a page turning using the designated position 

25 travel speed. Designated position points A and B 
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respectively move from points At 1 and Bt 1 to At 5 and Bt 5 as 
shown in FIGS. 136A and 136B. Designated position points A ' 
and B' respectively move from points A't x and B , t 1 to A't 5 
and B't 5 as shown in FIGS. 13 6C and 136D. The travel speed 
5 is considered to be higher in the first case shown in FIGS. 
136A and 136B than in the second case shown in FIGS. 136C 
and 136D. 

FIGS. 137A-137G show the corresponding data samples 
that are interpreted as the page turning using the 
10 designated position travel speed. In a graph 137 01, at time 

t x , the designated position points At x and A't x are at the 
same coordinates (4,2), and the designated position points 
Bt 1 and B'ti are at the same coordinates (5,3). At time t 5 , 
the designated positions A and B are respectively at 

15 coordinates At 5 (3,3) and coordinates A't 5 (3,4), and 
coordinates Bt 5 (4,4), and coordinates B't 5 (4,5). 

Tables 13702 list position data of the designated 
positions A, B, A', and B* from t x to t 5 . A table 13703 
lists the travel speed of the designated positions. As 

20 listed, the travel speed of the designated position point A' 
being 0.559 and the travel speed of the designated position 
point B' being 0.559 are respectively greater than the 
travel speed of the designated position point A being 0.35 
and the travel speed of the designated position point B 

25 being 0.283. 




Eighteenth embodiment 

An eighteenth embodiment of the present invention is 
now discussed. The eighteenth embodiment accounts for a 
5 contact pressure of a designated position as the designated 
information other than the designated path when an operation 
to perform is interpreted from a combination of travel paths 
of at least two designated positions. 

FIG. 13 8 is a flow diagram showing an algorithm that 

10 uses a contact pressure at a designated position as the 

designated information other than the designated path, in 
step S13801, a process is performed to acquire the contact 
pressure at the designated position. In step S13802, a 
designation interpretation process is performed to interpret 

15 the input based on the contact pressure at the designated 
position. 

FIG. 139 is a flow diagram showing the designation 
interpretation process based on the designated position 
contact pressure. When it is determined in step S13901 that 

20 the contact pressure at the designated position is equal to 
or greater than the maximum criterion value, the algorithm 
proceeds to step S13902. The input is interpreted as one of 
the maximum number of screens, the maximum number of items, 
and the maximum magnification. When it is determined in the 

25 step S13901 that the contact pressure at the designated 
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position is smaller than the maximum criterion value, the 
algorithm proceeds to step S13903. When it is determined in 
the step S13 903 that the contact pressure at the designated 
position is equal to or greater than the repetition 
5 criterion value, the algorithm proceeds to step S13904. The 
input is interpreted as an operation to increase one of the 
number of screens, the number of items, and magnification. 
The algorithm then proceeds to step S13905 to narrow 
repetition intervals . When it is determined in the step 

10 S13903 that the contact pressure at the designated position 
is smaller than the repetition criterion value, the 
algorithm proceeds to step S13906. The input is interpreted 
as an operation to increase one of the number of screens, 
the number of items, and magnification. The algorithm 

15 proceeds to step S 13 907 to interpret the input as one of a 
screen shifting operation, an item advancing operation, and 
an expansion/contraction operation. 

FIGS. 140A-140D show an operational example that is 
interpreted as a screen shifting operation in response to 

20 the designated position contact pressure. Designated 

position points At 1 {3,3) and Bt 1 (4,4) cause a high contact 
pressure than designated position points Ct 1 (3,3) and 
Dt x (4,4) . 

FIGS. 141A-141H show the corresponding data samples 
25 that are interpreted as the screen shifting operation in 
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response to the designated position contract pressure, in 
graphs 14101, for a time elapse from time t a to time t 5 , the 
designated position points A and B respectively move from 
Atj ( 3 , 3 ) and Bt x ( 4 , 4 ) move to At 5 ( 3 , 1 ) and Bt 5 ( 4 , 2 ) . 
Similarly, designated position points C and D respectively 
move from 0^(3,3) and Dt 1 (4,4) to Ct 5 (3,l) and Dt s (4,2). 
Tables 14102 list position data of the designated position 
points A, B, C, and D from time t. 1 to time t 5 . A table 14103 
lists the contact pressure at each designated position point. 
As listed, a change in the contact pressure of each of the 
designated position points C and D from time t x to time t 5 is 
greater than a change in the contact pressure of each of the 
designated position points A and B from time t x to time t 5 . 

Nineteenth embodiment 

A nineteenth embodiment of the present invention is now 
discussed. The nineteenth embodiment accounts for travel 
distances of a plurality of designated positions as the 
designated information other than the designated path when 
an operation to perform is interpreted from a combination of 
travel paths of at least two designated positions. 

FIG. 142 is a flow diagram showing an algorithm that 
uses the distances of travel of a plurality of designated 
positions. In step S14201, a process is performed to 
acquire the distances of travel of the designated positions. 
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In step S14202, a designation interpretation process is 
performed to interpret the input based on the distances of 
travel of the designated positions. 

FIG. 143 is a flow diagram showing the designation 
5 interpretation process based on the distances of travel of 
the plurality of designated positions. In this algorithm, 
when it is determined in step SI 4 3 01 that the travel 
distance is equal to or greater than the maximum criterion 
value, the algorithm proceeds to step S14302. The input is 

10 interpreted as one of the maximum number of pages, the 

maximum number of screens, the maximum number of items, and 
the maximum magnification. When it is determined in the 
step S143 01 that the travel distance is smaller than the 
maximum criterion value, the algorithm proceeds to step 

15 S14303. When it is determined in step S14303 that the 

travel distance is equal to or greater than a repetition 
criterion value, the algorithm proceeds to step S14304. The 
input is interpreted as an operation to increase one of the 
number of pages, the number of screens, the number of items, 

20 and magnification. The algorithm then proceeds to step 
S14305 to interpret the input as an operation to narrow 
repetition intervals. When it is determined in the step 
S14303 that the travel distance is smaller than the 
repetition criterion value, the algorithm proceeds to step 

25 S14306. The input is interpreted as an operation to 
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increase one of the number of pages, the number of screens, 
the number of items, and magnification. The algorithm then 
proceeds to step S14307 to interpret the input as one of a 
page shifting operation, a screen shifting operation, an 
5 item advancing operation, and an expansion/contraction 
operation. 

FIGS. 144A-144D show an operational example that is 
interpreted as a page-turning operation in response to the 
distances of travel of the plurality of designated positions. 

10 Designated position points A and B are respectively moved 

from coordinates At 1 (4,2) and coordinates Bt 1 (5,3) at time t x 
to coordinates At 5 (3,3) and coordinates Bt 5 (4,4) at time t 5 
as shown in FIGS. 144A and 144B. Designated position points 
A 1 and B' are respectively moved from coordinates A '^(4, 2) 

15 and coordinates B't 1 (5,3) at time t x to coordinates A't 5 (3,6) 
and coordinates B't 5 (4,7) at time t 5 as shown in FIGS. 144C 
and 144D. 

FIGS. 145A-145G show the corresponding data samples 
that are interpreted as the page-turning operation in 

20 response to the distances of travel of the plurality of 
designated positions. In a graph 14501, at time t lf the 
designated position points At x and A'tj are at the same 
coordinates (4,2), and the designated position points Bt 1 and 
B't x are at the same coordinates (5,3). At time t 5 , the 

25 designated positions A and B are respectively at coordinates 
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At 5 (3,3) and coordinates A't 5 (3,6), and coordinates Bt 5 (4,4), 
and coordinates B't 5 (4,7). Tables 14502 list position data 
of the designated positions A, B, A 1 , and B' from t x to t 5 . 
A table 14503 lists the travel distance data of the 
designated positions. As listed, the travel distance of the 
designated position point A' being 4.123 and the travel 
speed of the designated position point B' being 4.123 are 
respectively greater than the travel speed of the designated 
position point A being 1.414 and the travel speed of the 
designated position point B being 1.131. 

Twentieth embodiment 

A twentieth embodiment of the present invention is now 
discussed. The twentieth embodiment accounts for stationary 
times of a plurality of designated positions when an 
operation to perform is interpreted from a combination of 
travel paths of at least two designated positions. 

PIG. 14 6 is a flow diagram showing an algorithm that 
uses the stationary times of the plurality of designated 
positions. In step S14601, a process is performed to 
acquire stationary time of a designated position. The 
algorithm proceeds to step S14602. When it is determined 
that the designated position remains stationary for a 
predetermined duration of time, the algorithm proceeds to 
step S14603. The input is interpreted as an operation for 
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designating an area. The designated area is thus clearly 
distinguished from the remaining area of a display. When it 
is determined that the designated position is not stationary 
in the step S14602, the algorithm proceeds to step S14604. 
5 The input is then interpreted as an operation for the 
designated area. 

PIGS. 147A and 147B show an operational example that is 
interpreted as an area designating operation. Designated 
position points A and B are placed at At x and Bt 1 on a line 

10 of characters at time t x . When the designated position 

points remains at At 5 and Bt 5 on the same line of character 
at time t s as shown, the area between the designated position 
points A and B is interpreted as being designated. 

FIGS. 148A-148D show the corresponding data samples 

15 that are interpreted as the area designating operation. In 
a graph 14801, the designated position point A continuously 
stays at coordinates A (3, 3) from time t x to time t 5 . Also, 
the designated position point B continuously stays at 

coordinates B(4,4) from time t 2 to time t 5 . Tables 14802 
20 list position data of the designated position points A and B 
from time t L to time t 5 . A table 14803 lists the distances 
of travel of the designated position points A and B. As 
listed, the distance of travel of the designated position 
point A is zero at time t ir and is continuously zero from 
25 time t 2 to time t 5 . Also, the distance of travel of the 
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designated position point B is continuously zero from time t x 
to time t 5 . The designated position points A and B remain 
stationary from time t x to time t 5 . 

FIGS. 149A and 149B show an operational example that is 
interpreted as an expansion operation to be effected on a 
designated area. The designated position points A and B are 
placed at At 5 and Bt s on a line of characters at time t 5 . The 
designated position points A and B are respectively moved to 
At 6 and Bt 6 at time t 6 . This input is now interpreted as an 
operation to expand the designated area. 

FIGS. 150A-150D show the corresponding data samples 
that are interpreted as the expansion operation to be 
effected on the designated area. In a graph 15001, the 
designated position points A and B respectively continuously 
stay at the same coordinates A (3, 3) and B(4,4) from time t L 
to time t 5 . The coordinates A t 6(2 / 2.5) and B t 6(4,4) taken by 
the designated position points A and B at time t 6 are spaced 
more apart from each other than the coordinates At 5 and Bt 5 
are at time t 5 . Tables 15002 list position data of the 
designated position points A and B from time t : to time t 6 . 
A table 15003 lists the change in the distance of travel of 
each designated position point. As listed, the travel 
distances of the designated position points A and B are zero 
from time t 1 to time t 5 . The magnification resulting from 
the distance change between the designated position points A 



and B is 100%. At time t 6 , the travel distance of the point 
A is 1.118 and the travel distance of the point B is 2.236. 
The magnification resulting from the distance change between 
the point A and the point B increases to 285%. 

The present invention may be implemented in a system 
constructed of a plurality of apparatuses (including a host 
computer, interface units, a display, etc.) or may be 
implemented in a standalone apparatus. 

A program code of software for carrying out the 
functions of the embodiments is loaded in a computer in a 
system or apparatus connected to a variety of devices so 
that the devices perform the functions of the above 
embodiments. The variety of devices operate according to 
the program code stored in the computer (CPU or MPU) in the 
system or apparatus . Such embodiments fall within the scope 
of the present invention. The program code of software 
performs the functions of the embodiment. The program code 
itself, and means for feeding the program code to the 
computer, for example, a storage medium for storing the 
program code, fall within the scope of the present invention. 

Available as storage media for feeding the program code 
are a floppy disk, a hard disk, an optical disk, a magneto- 
optical disk, a CD-ROM, a CD-R, a magnetic tape, a 
nonvolatile memory card, ROM and the like. 

By executing the program code read by the computer, the 
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functions of the embodiments are performed. Furthermore, 
the functions of the above embodiments are performed in 
cooperation with the OS (operating system) running on the 
computer or another application software program according 
to the instruction of the program code. Such a program code 
falls within the scope of the present invention. 

The program code from the storage medium is read into a 
memory incorporated in a feature expansion board in the 
computer or in a feature expansion unit connected to the 
computer. The CPU mounted on the feature expansion board or 
the feature expansion unit performs partly or entirely the 
actual process in response to the instruction from the 
program code. The functions of the above embodiment are 
executed through the process . Such a program code falls 
within the scope of the present invention. 

To incorporate the present invention to the storage 
medium, the program code of the above-referenced flow 
diagrams may be stored in the storage medium. 

Although the present invention has been described in 
its preferred form with a certain degree of particularity, 
many apparently widely different embodiments of the 
invention can be made without departing from the spirit and 
the scope thereof. It is to be understood that the 
invention is not limited to the specific embodiments thereof 
except as defined in the appended claims. 



While the present invention has been described with 
reference to what are presently considered to be the 
preferred embodiments, it is to be understood that the 
invention is not limited to the disclosed embodiments. On 
the contrary, the invention is intended to cover various 
modifications and equivalent arrangements included within 
the spirit and scope of the appended claims. The scope of 
the following claims is to be accorded the broadest 
interpretation so as to encompass all such modifications and 
equivalent structures and functions. 



